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' stability; occupational instruction programs an>d equipment and 
facilities. (LBH) ' 
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SYSTEM FOf^' COLLECTING, ANALYZING, AND USING INFORMATION ' " ' 

- ON INSTITUTIONAL CONSUMER "projection PRACTICES:- ■ 

J • * - . • 

. ACCREDITATION USER GUIDE " * 

a ^ t . - . ^ . •• * . , •. ■ • 

* General Introduction 
>i ■ • • ■ 

.1 • • . . ^\ 

Background ■ ' ^ - ' ' p \ 

Private, non-governmental accreditation of p&stsecondary. institutions 
play4«^an important role, in protecting students from educational malpractice. 
This role*is an apparently inseparaWe i^art of one of accreditation's major . 
^ purposes, which^iip to certify that an accredited institutioi> haS met • 

established standards. of educationa> quality, in accordance with its stated 

i' _ • * 

educational ^goalsw^ It is difficult to see how an institutio;;^|r wjth valid : 

educational goals' could provide a "quality" program in the absence of proper 

- " * . ' ^ ' " ' 

safeguards to ,p;rotect students from such abused |s: fraudulent or misleading- 

advertising and recruiting techniques; lack of, full disclosure of Calient- 

information about institution conditions, practices, and policies wjlich ^ 

affect students; inadequate student services, irjcluding student oj^lentation, 

job placement, arid maintenance of proper records; inferior facilities, course 

offerings', and instructional staff; and financial instability* " • 

. j • • 

The y*$. Office of Education (USOE) is especially concerned ^about | 
accreditati-on's role in'postsecondary student consumer protection, because * 
institutional ^accreditation is- normally a coreouisite for institutional 

• • ■ • ■ ' / • 

.eligihiltty to participate in Federal programs/ of financial assistance to 



It should te notfed at the outsfet that the aiithors discrimiijate between 
\ "instituiionar' accreditation, which normally applies to an enfire educa- , 
tional institution, ani^ "specialized" or, "program" accreditation, whici} 
normally .applies to programs, departments, or other units which offer" 
specialized educational services within an institution. This user guide 
is directed toward institutional accreditation agencies only, except in cases 
. where specialized accredi'tation agencies accredit an entire institution, 
. by.*vi,rtu4'of that institution's jfevotion to a single educational program* ' 



students.. As part 'of this Congress ianany-mandatqd role, USOE peribdica'lly ' 
._eubLishes.«Jist. of "nationally recognized" accreditation ag^j^S^whidL^nj^^^ 
have been wwluated by the U.S. Commissioner of Education and found to be 
Veliable authorities as ;:oL the quality of 'training -offered."^" The origins^' 
and growth of the Commissioner's evaluation process, with its criteHa for * 
recognition of accredita.tion agencies, have JfeeV.'ardequately. described els'e- • 
where (Chapters C and D of-^rlans, Levin, Bauer, & Arnstein. 1975; and Brown,. 
1975) and- will not be discussed here, The mostVecent recognition criteria/ " 
as published in the 'Federal Register of August 20, 1975«,. contain sections en 
^ the following chahact§pi^tics of a -"recognized"' accreditation agency: 
'f4jnctional aspects (is national or regional in. scope of operations,, has * 
■sufficient 'organyzationa^ capabi^lity, utilizes, proper procedures, etc.); 
responsibility- (meets clearly defined needs, is responsive to the public 
interest, assures due p»*ocess, etc.);' reliability (has been in operation not 
less than two' years, conducts regular review of its st^ards^policies, and" 
procedures, etc.); and autonomy (can exercise independent judglhgYit, i.s free . - 
from conflict. of interest*). The criteria are applied and agency recognition/ . 
limitation/termination recommendations\are made to ^he Commissioner by ar\ 
Advisory Committee on Accreditation and Institutional E.1 igibil ity^ through' 
the Divisipn of Eligibility and Agency Evaluation (DEAE), Bureau of Post- 
secondary Education. ' ^ ' 

''/A number of well-tpubl icized institutional abuses of -students who .were' 
beriefi^ciaries* of .federal assistance prd^ams (e,g., Pifgsley'f Hardman', 1975; . 
ul|;''Congress, 'l974a, 19Z4b; Jung, Hamilton, Hell iwelT, McBain & Fernandes,. 
•1975;, Federal Trade Commission, 1974') 'has placed- increasing 'pressure on DEAE 
,to tighten Us evaluation criteria- for recognized accreditation' agencies. The * 
O-ivision currently requires a recognized agency, or agency seeking 'recognition, 

^From ZO^U.S.C n4r-(a). * • ■ , . 



/ 



tQ ^'demonstVate the capability and willingness to foster ethical practices 

^ among the institutions or programs which it accredits "'. Although it fell 

•s.hort of stringent recogniti6n standards proposed in-a, bill authored by v 

^Representatives Bell and Pettis (1975), recent language proposed by USOE'for 

inclusion in the Education Amendments of 1976 (Proffitt, 1976) would' fravev 

^required tlie addition of more stringent regulations by adding the words '*^ind 

the probity ef the institutions or school's offering such training" to the' 

"reliable lauthority as to- the quality of training" clause already cited from 

' 20 ll.S.C. .1141 (a). This additional- language was opposed by some members of 

* 

the accreditation community (c.f.; Young, 1976) 'because they saw in it the 
implication that accreditation agencies 'should "function in effect, as an 
arm of the government'-- policing institutional adherence to federaV . . 

mandated requirements in such areas as, , .consumer protection " ^ ' Much o^ 

.USOE's proposed language, was ultimately droppe4-f^m the 1976^Education 
Amendments which won passage, but disagreement remains cibout the ^degree to* 
which the. government should require accreditation agencies. to enforc* more 
stringeat student consumer protection standards, • ' »^ 

Th^e agencies which" accredit proprietary' (incorporated as profit-seeking) 
institutions are-more active i.n the»area of 'student consumer, protection than 
are the regional agencies which accredit private non-profit and public insti- 
tutions. For.example^ the "ethical practices" standards of proprietary school 
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Vrom Title- 45; Chapter 1, SectionM49.6 (b) (4), Federal' Regula*ti-ons, under 
the or.fteria on agency res^nsib.ility. . ' . , . 

^Accreditation newsletter. Council- on Postsecondary Accreditation',' 'September '• 
1975,. i (1), 1. 

3- ' ■ ' ^ ■ • ^ • • 

• which, by law, are eligible to participate in some federal a^sistanc'e programs, ■. 
including th.e Guaranteed Student Loan Progragi and the Ba.sic EducatitDnal Oppor- 
tunity. Grant Prpqram. Proprietary programs and courses are also eligible to 

( enroll veterans who receive educatiotial benefits under the G..I. Bill. 



accreditation agencies such as the National Assotiation of Trade and Technical 
Schools, j^ociation of Independent Schools arid College's, and ffetional Home 
Study Council all contain over 10 pages of prohibitions and requirement^^ ' 
rsuch topics as advertising and recruiting, tuition refunds, and disclostire 
of material facts. In' contrast, the ethical practice standards of reg^'onal 
accredi tuition agencies rarely exceed one page. Greater activity in the, 
pro[>rietary accrediting sector may ,tie a reaction to- the fact that mos't recorded 
abuses of student consumers have occurred 'in proprietary schools (see Helliwell 
& Jung, 1975). It may als(5 be a pari:ia]^'resul t of the fact that most prpprie- 
tary schools offer training, specif ically/geared toward" immediate ""occupational 
preparation, while the goals of non-proprtetary higher education institutions ^ 

^are mu(^ less specific in fostering student expectations of post-educational 
jol> opportunities. . However, with /ecent'Ty declining enrollments and the. 
concurrent grQw'th, of nor^tradi tional programs, public and private non-profit ' 
institutions have received more attention (e.g., OrTans, et aU,'1974,'- 

.Chapter G>, and incidents of fB-ilure to ^rant partial refunds, mi'slgading ^ 

' advertising .and recruiting practices, and lack of minima.ll^ adequate disclosure 
have provided convincing evidetice that proprietary schools are not the sole 
perpetrators of student Consumer abuses. The issue of consumer protection in^. 
a'ocjedi'teS institutions exists regardless of wh.ether the institutions are pro- 

priet;a'ry or non-proprietary or have qccupational or non-occupational educrf- 
t^ional goals- \ , ■ • * \ . i 

As was mentioneci. earlier, accre^ditation by .a USOE-reeognized accreditation 
agency is not tantampuRt to institutional eligibility, even though this*fact 
is octasqonally lost by ^some 'commentators (e.g>, Orlans, et al., 1974), In 
addition tp ^private Accreditation, the $.o-called "tripartite" system of insti- 

,tutionaT eligibility for TJSOE-administered ^iiiancfal Assistance p^rograms also 
regvire^: ' (1 )' Starte authorization and (2) .compliance with the assistance 



program regulations, established. by USOE. As outlined by Kaplin. (-iW), the 
state-level "partner's" in»t*his system have 'direct governance responsibility 
over postsecondary. institution^^ao.d, "as/a result, can play a major role'in 
preventing an^l punishing ca.ses of student abuse' by institutions, whether or 
not thjase institutions are eligible for federal' funds.' "Even though. the 
Education Commission of the States >has proposed Model State Legislation 
(ECS, 1973) and even though there is evidence that state regulatory agenctes 
are more active in this area than has been assdmed (National Association of 
state Administrators and Supervisors of Private Schools, undated), there- is 
general agreement that state laws and enforcement mechanisms are still of 
uneven effectiveness in protecting students from institutional abuse. * 
. ' USOE has also moved to stren^gthen its own regulations for t'he Guaranteed'' 
Student Loan Program (GSLP), placing tighter restrictions on^loan disbursement 
practices and requiri.ng institution officials to sign a Terrss of^greement 
document obligating them to make good faith efforts to inform prospective 
students "about the institution's pro^gram^ facilities, faculty, and, for ■ 
occupational training programs, employment and Earnings datq on graduates 
(USOE, 1975). Non-compliance with these regulations is, punishable by .limi- 
tation, suspension, or termination of eligibility f6r the GSLP. Institutional 
eligibility regula'tions for Hi financial assistance programs authtjrized ' 
'under Title IV of the Higher Education Act are-likely to be tightened u'nder 
the* Higher Education Act ^Amendments of Historically, 'however, USOE has 

favored a policy of attempting to strengthen the functii^r) of state authorizing 
and accreditation tg provide improved student consumer <prdtectioif^at^the post- 
secondary l^vel (Hercell, 1974).,' and DEAE -continues to refer the vast majority 
of student: xomplai fits it receives about accredited institution/to the accred- ^ 



More detailed i'n format ion on the effectiveness of state-level oversight with 
respect to student consumer "protection will belivailable in"" 1977 from a USQE-, 
sponsored research study (s^ee Hamilton, Jung, Helliwell, & Wheeler, 1976)/ 



iting agency in^^'olved, although school*. visi*ts may occasibpally be undertaken 
' ' ^' ^ • ^ ^ • * ^' ^ 

' (Pugsley'.S Hardman,. 1975). . ^ ' W ' * ' * 

Purpose of this Guide . • t * ^ ' * 

As -dhe tripartite system partner with the clearest role in assessing 

/ • • • 

institutional quality, it would seem- that ^accredit'ati on does have a major 

^interest ?|h oBtaining information on the consumer protection policies and . 

practices of post secondary institutions/ whether or not this interest is . . 

dictated ty federal law. The purpose of this guide is to describe: -(l) ,a 

set of institutional conditions, policies, and practices which are potentially 

abusive to students and (2) a system^ for collecting, analyzing, ^and using 

•quantitative data on these conditions, p,olicies, and practices. Possible 

uses include: (1) setting consumer protection standards .and goals which 

institutions should meet in order to'gain or keep accreditation and (2) estab:; 

lishing an institutional self- reporting sy$tem^wM>ch 'could be the basis for . 

periodic self-evaluations and possibly central reporting to' th^ other, * 



governmental iremberfs of the tripartite eligibility^ system (i.e., states and 
the Federal government)/ ^ ' 

Ihe core of this self-reporting system js the Institutional Report Form 
(IRF), with two 'separate, versions for degree-granting and occupational ^ 



training institutions. It_is a relatively simple TS-topic, 53-item question- ^ . 
naire that caji be coTnpleted by. a knowledgeable Instltutionarl official in l^ss ^* 
than two hoursj^ Although some It^msj^ represent objective determinations that 
"this Institution does it/doesn't do it" or "has it/doesn't have it." The 
*-13 ^bpics ire: ~ , ^ , * ' 

L 'R^^un'd Policies agd* Practi ces " ^ ' ^ , , ' 

2. Advertising Policies and Practices « 

3. ' Admissions Practices ' - • ' . 



,4, Instructiona-1 Staff Evaluation Practices 



5, Discloslins ^'n Written Do'cuipents . • . . 

J ' ' ' . ■ . / > 

^' 61. Student Orientation Practices \ ' ^ S - 

• Job; Placement Services' and follow-up of Graduates 

8* Recordkeeping Practices • ^ . /, « . < ^ 

9. 'Maintaining Instruction Sljaff Stability , ^ \ 

10. Representation of Current Approved or Accredited Status 

11. Financial StaB^jlity - , ' ... 
Occupational instruction Programs^ . ' . ' / 

13. Occupatibnal Instruction^ Equipment and Facilities ^ 



The critical requirements. for each item^olT^the IRF are: \ ' ^\ 

* • Tt relates well to an institutional practice or policy which is generally 

agreed to t^^ abusive (or the absence of •which- is generally agreed to be 
^ abusive) to students; ^ . / * 

• it-clearly indicates wha^ practices' ai^e undesirable, with n9 cbmp'lex 
statistical transformations required; ' / \ 



/ 



• it can be weighted , such_thjjt, quantifiable scores can be produced for - 
eacji of the 13 topics; / 

• it can be verified ^ either through easily accessible documenta,tiorf or, 
alternate information* sources; 

• it can be marjced without imposing an Unreasonable burden on either th6 
source institution or the- collecting agency; 7 ^ 

• It taps policies and practices which are modifia^e and within the 
. power of every institution to^modify; and 

• it is a*t least potentially useful to an instltiation in its own seTf-s4:udy 
and self7i[iiprovement efforts' - . 

As a result of these requirementsT^i tems^on m;(.nimjini acceptable levels of 

school dropout rate , withdrarwal rate / and/or graduate placement rate are speci- 

, ~ . / • . , 

fically not included. It seems^ clear that such) rates, even if the'y' could be* 
calculated accurately and at reasonable cost,/ are very difficult to' interpret 



Hhese topics are. contained in the IRFs for jpcupational training institutions 
•only* " " ' ' ' 



meaningfully. For example, there is no evidence to support the deceptively,, 

simple hypothesis that abusiv.e institutions have higher dVopoiit and default 

rates or lower placement rates thSn /lon-abusive institutions. The evidence 

that is ^available does suggest that dropout, defaujt, and placement are much 

. . .more afunction of the socio-economic status, initial employment status, 

^ motivation, and employabilify of entering 'students. These variables are not 

wi.thin the power of an institution to control,, unless it uses discrminatory 
*' . ' ' , ■ *\ ^ • 

adaissions standards wllit^h'are generally considered unacceptable and even , 

unlawful. . * ♦ • , ' 

In addition to the 13-topic questionnaire , the system consists of a set 

' .of data "coding, keypunching, analyzing,, and .reporting specifications, intlud- 

field tested and extensively documenT:ed computer programs suitable for" 

immediate implementation of the possible accreditation uses to be explained 

in detail in the-'Vinal sectiooDf this guide. " , / • * 
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Collecting Information on Institutional Consumer 
• Protection Policies and .Practices / , 

\ ^ , 

Definitfbn of Edu cational Consumer Protection 

' \ \ — ^ — • ' 

In an effort to define precisely the nature i)f student consumer abuse, \ ' 

AIR. staff undertook a comprehensive search of the- literatQre, which included: 

(1) the record's of hearings conducted* by -subcommittees of the .li-S'.. House of \ - 

Representatives Committee on Education and Labor and Committee on GovBrnment 

I)petations; (2) reports 'o^blished by the^Education Coiranission of the States.,. •* "'^ 

* > ^ f ' *' 

as. a result of two national conferences on student consumer protection; (3) a^ 

. report published by USOE as' a result of a national conference -on institutional 

• * » 

eligibility; (4) the 40+ volume fi]e put together by the staff of the federal ^ ^ 
. • Trade Comrtiissi on .in support of the'ir /proposed trade regulation rule for 

proprietary vocational apd home study schools; (5) the .student complaint files. 

- of USOE's Accreditation and Institutional •Elagi{)ility Staff (now DEAE); and-'' 

/ over 60 other sources (see Helliwell & Jung, 1975). In general, we were- seeking 
to identify/ jnstitcitionaV policie's and practices which had the potential to 
mislead students and frustrate their efforts to obtaih an education. ^We hiade* 

- several* decisions which shquld be made Explicit here. 

«• * • 

Students are ronsumers' . Some authors (e.g., Enteman, 1975) haVe^ "attempted ^ 
to <y)ntend that students,^ as participants ip. the educational process, are not ' 
' "consuraers" in the trueVsetise of that word. While we do believe that a good 
deal of the respMSibitity for learning dur.ing any educational experien-ce • 
rests wfth^fhe student* jt/is' qlear that some school practices deprive the 
stiident of even an opportunity to le^rn; furthermore^- some practiq^s Ve so 
blatantlj^ fraudulent and unfair that they would be abusive regardless of the 
j)rOduct or service that was bein.g offered. To .the extent that schools do 
.market an educational service, .students are clearly the consumers*. 

" • r 

> O ' 

II' . V ■ 

-9-* " 



Consumer -protect! on is unequal to better €ducationa1 decision making . 
Numerous ^calls have been registered for' systems to assist students in making 
better d'ecisions about poslsecondapy education. Such calls usually include 
reque'sts for disclosure of Wtter information on the course ^options, social 
climat6, financial; aid, ^tc, available at cin institution, plus providing 
students with a^tv insight into the world of^work and the student's own goals', 
interests, abilities, limitations, etc- Information of thi§ type-is no 'doubt 
an aid to student decision making. 'However, such information is not tfie same 
'as info rnpat ion about institutional .practices which abuse "Students. The limited 
set of information us'eful for providing better "student consumer prated ti on" 
' should be carefully distinguished* from the^much 'larger set required -to faci^ 
*Ji,tate "better student decision making;" we" feel this distigctjoTi carr-help 
-avoid much unnecessary confusion and effort. ■ . - . . - 

. ^ Jhe majop'^kinds oS^ consumer abuse r Appendix A presents a list^of poten- 
tia.lly abusive-institi^tio>i^l. practices' categorized according to the T3 topics 
listed on page 7 of this guide. Admitte.dly th^re is a thin line between ' . 
"sharp'^ business. operations or unintentional oversight and eilucational m^l- 
practice. .Practices -which ar.e illegal in qrie state may be perfectly legal 
in the neighjioring state! Tfie Vistecl practices are those which clearly: * 
(1) are 'designed<i3 mis'lead styd^ts; (2) endanger students' -opportunity to 
r^oeive tJhe promised gducatioVial services; or .(3).denyistudeats prdper recourse 
Ther^-are no doubt 'other^^pptenti ally abusfve practices, and in the 'course of.' 
our literature revifew v^g discovened^many of .them. The ones listed in Appehdi-x 
were chosen because, they represented, in 'our judgment, tht set-^that WaV most 
dangerous to students receiving federal aid'andmiosf^asity detectable . , - - 
without recourse to': . (1) excesTive**si^jectiv;it (e.g', T wtthoujt attempting tcr 
xiefine and measure "poor mo-ral character of administrators"), or- (2) excessive* 
expense (e.g., without requiring' schools to carry qui costly data ^Qo/llection 



and tabulatibn'efforts- to calculate rates of "training-delated" job success 

of gra'd.uates or bUy costly performance or 'surety bonds). ■ • . ' " 
The converse of the abuses "jn-sted in Appendix A constitutes our opera- - 
. tional defi-nition of ecfucational consumer projection. .. instituti-onal policies 

artd practices which: (1) provide disclpsure of salient fa.ctsj (2) safeguard* 
' students' opportunity 'to receive promised educational -service's ;>aQd -(.S); provide 

students with propel" recourse.*' ' ' 

« » ' * * 

The Institutional Rgport Forms * 

' ^ ' \ \ ^ ^ • . 

^two IRFs haye'been designed to collect information-, from degr'ee-grantfng 
and occupation^iy^ai^ng' institutions, about' the potentially abusive practices 
listed- in Appendix A. In all cases, the IRR. items have ^beeh selected. according 
to the critical" requirements I'isted on pages > and 8 of this. guide. A "yes/no/ 
not applicable" response format has^^en adopted for all' except two items (on 
instructional staff stability), whiph rlquire,^ entering of a number and a 
percent.' Thre IRFs are structured as questionTiaires to be cpmplejteci "hnd certi- 

* - '^ f • ' , 

fied as accurate^by institutional administrators themselves or by accreditation 
team members during an; acfreditati^on site vi"sit. IRF completion requires" .. ' 
examination of certain institutional policy statements, records, and public- 

' . .i • ^ , ■; • 

dissemination and^istlosyre material's.^ Th§' completion process requires - 
frQm one 'to three hours, depending on the obt'atned responses.- r * '^^ 

Appendix B contains the basjc IRF for Postsecoiltlary Occupati'onal Training 

J , * ■ , " ^ ' » 

Institutions. ^Appendix (> contains modificat.ions to, the occupational IRF v/hich 
mteit more appropriate for degree-granting institutions*., These appendices*'- 
also -contain a brief discussion of purpose of each. of the 13 topics and 
detailed "instructions for. mark-ihg iach item. , "■ . 

.The occQpational IRF (AjD^ehdix B) sfiould be used for aay institution* which 
of^rs ^terminal occupational programs* of pos,tsecondafy education. I^, the insti- 
tution algo offe/S' transfer-oriented programs or -degrees in association with 



r 

- i'ts- occupati'onal- programs (e.g., the A. A." or A.S.. degree),' the occupational 
JRF is. stin ^ropriate. If the institution offers only a program of higher 

• v ♦ • • • \ 

education leading to batcal aureate or graduate degrees, the degreerg»»anting 
IRF (Appendix C)-is -appropriate. * ^ " ' . " 

. Whenever possible, each item in the JRF should, be marked; ah attempt has 
been made to provide "Not Applicable", response options in each case where an 
item gjigfit prove inappropriate for an institution of' limited size or educa- 
tional purpose. These options should always be used in preference to omitting", 
an, item. Missing^responses can prove to be very troublesome during the analysi 
of IRF' data, to be discussed in the next section. • • • . > 



Analyzing, Data on Institutional Consumer Protection - . 
* Policies and Pract-4ces , > 

. ^ • ' The data analysis specifications for the IRF have" been formulated to ' 
accomplish the following steps for each institution which is being assessed: 
'(1) convert the hand marked responses .in the ^questionnaires (Appendices B 
■and_C) into coded, computer processable data; (2)' weight these data, by hand 

or by computer, according to the seriousness of each response as an indicator 

• ■ ' *. . * 

.of potential consumer abuse; (3) produce summary weighted scores for each of 

/ the^S topics on the IRF^ an^^overaH insti.^^utkjn "Sc6r;e .(these .ar^ callecp" 

. Top.ic Scores and the Institution Score, respectively^; and/(4) provide for the 

verification of these scores, and their correction /in t[)Qi' event of data 

processing errors. * / ^ 

These analysis specifications allow for both hand' processing and 

computer processing; for individual institut:iori self-analysis , hand processing 

^ is sufficient; for processing a larger number of MRFs at one time, computer 

processing is more efficient. The break-even .point (that point at which 

computer processing, will probably be cheapefr and more ef-^cient than hand 

processing) is approximately 50 institutions per year* 

-It is not possible for the authors of this guide to predict the type of. 

electronic data processing equipment which will be available to any particular 

user of the IRF system. In discussing computer processing specifications, we 

have therefbi:e chosen to avoid equipment-specific terminology and 'use generic 

; names where possible. - \' ' ^ • 

• * ■ ' " . 

■ Coding and Editing the IRF .Data 

■* For computer processing, IRF responses are coded by keytaping or by 
direct data entr^ through a remote terminal. Appendix D contains the specir 



• Oilly 11' topics are, included on the Degree-Grarrting IRF (see Appendix C). 
O • ' ' ■ ■ -13- . • * ' 



•/ > • • . • • - . , 

'fications and instructions for coding and editing IRF data for input 'into 

the weighting computer program de^crtfted in. the next section. If .key.taping " 

is used, we have assumed a 120 byte relspcd length. Because^ each. IRF record 

requires 172 bytes, t^o' records are required under this 'option. Column 2 

of Appendix D contains ?the, length in bytes of each item; column 3 contains_^ 

' the sequential byte location for each item'.under the keytaping pption; and. • 

^ column 4 contains the sequential byte location for sfich item under the direct 

data entry option or for the merged record under the keytaping option. It is 

. essential that" these data locations be maintained exactly in order. to pres,erve 

the accu^racy-of the weighted data to be produced by the computer program. In^ 

g^neral^, we have adopted a system of coding '0' for NO answers, '1'. for YES 

answers,, '8' for not applicable resppnses and '9' for miss'ing ^ata. These. 

^jnstinjGtionl are contained- in column 5 of Mipendix D. ATI coding should be 

rgutineiy vVr^ied, ^nd a frequency; distribjstion of the coded data should be ' 

created and i^pected for. out-of-range mi<nbers. 

V Editing can be done either before the IRFs are coded or during the 

coding operation. Editing is the process of inspecting for directed omissforis, 

missing data, etc. to insure t:hat they are coded 'According to the specif ica- 

fns in column 5 of /Appendix D. / » . ^ ^ 



Weighting the Coded IRF Data . • • ' 

' tkF responses are weighted according to the s'everity of the potential 
institutional abuse they reveal. The weighting procedure is an essential part 
of the Ij{F-processing system, .l?ecaus*8 any attempt to quantify the adequacy Af. 
an institution's^ consumer protection' policies and practices requires that 
allov/ances be- made to discij^inate between major and minor potential abuses/ 
• The IRF weighted score is somewhat like a golf score., 'The higher the ' 
,^;9tbre, the worse the performance. Each revealed potential for^ abuse adds 
weighted points; the greater the potential for abuse, the more points. An 



institution's overall. sco?e is the sum of all its points, and the higher the* 

: ^• • ' ■ . r- - • 

scored the more -likely students are to encounter abuse* Topic scores are 

2 

the' similarly summed, points for each of the 13 top.ics on the IRF, Appendix, CP 
, (calumn 6) contains the weights to be'apjDlied to e^ch item on the JRF': 

^ A cpmpirter program written in the PL/1 'language performs the mechanical * 
operations'of taking 4:ha^coded IRF responses asM'nput and producing the ' \ 
weighted Topif and Institution Scores as output. This printed output is,^ 
identified according ta an 11 ^ligit school ID number, wlifich can bfe 'modified 

^ *< ' . . ' ' ' \. / ^ * ^ ' 

as necessary accordijig to the unique needs 'of the -user.y Each school, however, 

^ * - - ^, * , * ^ ^ 

'must have some siifiilar unique designator,^since the program is , designed to 

•process a targe number of IRFs at one timk:. A program listing is included as 

Appendix E; .* • ■ , * ' ' / * • 

For computer -processing, it is always wise to routirtej'y weight a randomly 



.selected 5^ sampl* of ^RFs by hand 'and Compare- the hand-d|lculated results 
wT-th those produced by the computer to verify ttie accura'cV of the scores, 

' interpreting Topic'and Institution '^Scores * ^ [ 

1 • * An institution may achieve a "perfect" zero Institution Score or |bpic 

Score. on "the. IRF ^by not having any weighted responses- marked. "This situation 

is y'are. In a *37 institution field test o.f the IRF^3^-<Mnstitution Scores 

ranged from 90,to 430. fhB worst possible Jnstitujtton Score is ll50. *T2ib1e"l 

•contaiTfs a summary ofcthe maximum '(wor?5t possibj^e) weighted Topic, Scores for 

each^ topic. . . ' : • . 

* • 

, * ' , . ; • ■ • * 

Average Institution Scores obtained by various types of institutions 

. . ■ ' ' '. ' 'M - ^ . . " V 

in the field test are presented in Figure* I.' Thi;s figure represents 

J" --^ ' h " • 

^Scores are actually averages, calculated on the basis 6f all IRF items y^hich 
are' marked;^ this averaging is necessary to co^ect for the influence of missing 
data (i.e.,' omitted responses).. It i1s useful, however, to ,cons?ider. the IRF 
weighted scores a sum. - ,' . ' • . ' • ■ 

%nly 11 topics are included on the Degree-Granting IRF; 

3 ' ; • " '* • •• ■'. ^ '( . • . 

For a description of this field test, see the final -project technical report 
(Jong, Hamilton, Helliwell, Grpss, Bloom, -Shearer, & McBain, 1976). " 

■ ■•-■^7. , 



♦a primitive set of norms against which newly-dbtainfed IRF -scores may 6e 
compared. As experience with the use of the system 4^)(pands, *more represen- 
tative norms 'will no doubt emerge. . • * ■ • 



\ 



. Table 1 

Maximum Possible IRF Weighted Scores . ■ 

Topic Score • \ Oe'cupational ' Degree-Granting 

1. (Refund Pract.) 1000 1000 

^. (Advertising Pract.) 1456 ^ 145,0 * 

3"' (Admissions Pract. J 1090 1 09^0 

4. |"(lnst. Staff Eval.) ^ 1130, ' ' , . 1139 

5. (Wri^en ai'sclosure)"/ ^^650 . , 640 



' 6.; (Student Orient.).^ 'sbO^S " \ 

7. (Job- Placement) ' - 1180 ' • 1180 

(Recordkeeping), ' J330 ■ , 1^330 

J--9. '(Staff ■;|tabilityy 2500- ^ 2500" 

,.}V ■ ' 10. (Status. . Rel)resQnty . 1500-'. 1500 

"! 11.' (Financial Stabilit!y) . ^2140" ^ ■ , -'. ', -2140 



800 



12." .(Inst. Programs;) ^ 1880 • N.A. 

13..;j^(Inst.. Faci.litiesL .'. ISOO- '*- N.A. 



Institutioa Score - 115-0 1070 

' t ' ■ . • ..... - . , 



1150 
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FIGURE 1 - AVERAGE IRF FIELD TEST SCORES SHOWING DIFFERENCES BY ACCREDITATION,* i< 
• . . OWNERSHIP STATUS, AND TYPE OF PROGRAM ^ ; ^ ' 
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Applications of the IRF System - ' ' 
- . ■ . ' . i ■ ' 

The examples cited o'n the following pages are, in* the judgment of AFR 

staff ,^ practical. applications ^f the IRF system, ' i .e. , applications which 

can (and should) be undertaken by accreditation' users. Where mention is made 

of existing norms t^'.e., comparison bases for estimating the relative'magni- ' 

tude- of an IRF item response. Topic Score, and/or Institution Score), the. 

reference is always to "the 37 inst-ituti.on field test oV^the IRF system 

cpndacted by AIR in three statesduring early I97V Field test data are 

contained iji the final project^ technical report (aung, et ah, 1976).-' ; 

Ttie^ Self-Stiidy and Verification * , . ' -. 

The institutional self-study has become a primary aspect of the accredi-' ' 
tation process- 'in general, the self-study precedes a site \^'t'>t)y a team % 
of pe^r educators who calry out an, actual institutional evaluation to' verify 

** . r - • 

the .self-Study.^ The decision to award, limit, .or w.i^bhold accreditation is la 
based on^tbe sel'f-study, .its; on-site verification, -and. the recommendations of 
t|ie site yjstt^team. The self-study^ may be carried out by admin-istrajfem-s, 
faculty, or students of an insWtution, or a combination of these. 'For. . 
higher education institutions, it normally includes inquiri.es into the l^ollow- 
ing aspec\:s of institutional organization ^nd functioning: 
^ ,1. Goals-and Cibjectfves. ""• / 



2. Educational Program/Curriculum^ 

3: Faculty and Staff • , , < • • ' ^r-** • 

4.. Student Services ' ' • ^* ' _ * 

5. Public Services and Off-Campus Programs 

. ^ 6. Library. and Other learniRg Resources ^ - . ■ 

• • ^ . • I . " \ 

'7. Physical Plant and Equipment ^ .^ / '^ 

8. Financial Resources • 1^^ ^ . ' ^ * 



^ 9. Institutional Governance a:nd Administration \^ 
*"10.' Research - * 5^ - " » ' ^ - 

* * . ' ' ^ ^ r 

11^' Graduate Programs,, if any o ■ * C ^ ' 

*- For occupational tnainiijg institutions\.,points 10 and- 11 above are 
usually omitted. As previously^ menfioeed, proprietary school accrediting > 
agencies may add inpuiri'es into aspects such as advertising^arid |iromotion^> 
literature, recruiting and-admissions practices,^ refujid policies, and dis- 
closure (catalog) requirements, 'of ten uf^der the rubric "ethical sfandards^rV 
The fRF can^be integra ted .i nto t)iis' seljf'-study^process 'in a number'of^ "* 



ways/ Rrobably the easiest iVay would-bg 'to ^ncl We tJae basic form ^Appendices 

B and C) in the self-study '"manual. Vwh-iQh. is norma-lTy given to institutions^ 

^applying for accreditation or reaccredltatlon. Depending on the type of 

self-study process* cboseri -by. the institution, the IRF' could theif be completed*^ 

by administr!atOrs, facUlty,\andy'or' students,..' The findings ^ could serve as the 

basls^ for voluntary improvements on the part of the institution to cbrrect 

potential abuses prior to the site.visit^. Espec^ially 1nte<*estir|g' would be^ 

* » # ^ 

cases'where the self-study IRF scores bbta-ined from different segments of the 

school's staff or student body differed significarrtly, indicating Tack^of ^ 

awareness of specific policies, practiceiS,^andA)r corfditions in one ojr more* 

quarters. In any. -case, the data could be reported in the self-study ^^document, 



perhaps as a separate topic area- entitled' "Student ^El^fsu^er^ Protection." - 
Unfier this option, the task, of the*accredi tatioh team meml)ers would be to* ^ 
verify the reported dat^ t?ased upon their Own /observations ,and_1nt€rviews. 
As with all accreditation team reports,^ the results of this verification would 

be shared at the end of the visit with the ^school.rel^resentati'Ves etnd later 

with the accreditation agency decisio.n-making^body. The resulis would not 
have to b6 made public^ disclosure would -be at the option ^of the agency. V 



Periodic AccredXtation Agency j^onitorfnjrand Sharing 

\ • * ^ '* 

. Accredited institutions normally- are required to Submit annual or other 

*. • ^' \. '* * - • 

reports to their accreditation agency during the interim p^eriod between 

reaccreditation visits, These^reports often consist of nothing more than , 

' . ' * ' * / 

ffnancial, statements or subjective status assessments. We believe the value — ^ 
\bf these •periodic reports cdu.ld be sfgntf.i^antly;Bnhanced by adding the IRF 
' to periodic reporting requirements. The form could be completed, by insti- r 

tutional officials and submitted to the accreditation.^^agency on; an annual or \. ^ 
' semi-annual bc^sis, » Therfe the -IRFs from all institutions' cputd be centrally 

processed and maintained in a central repository. For^insti tutions whose* 

Inffitution Scores exceeded a given^evel (e.g., the 75th'p.ercentile), special 
;contacts could be instituted by the accreditation agen'cy^to obtain verification • 

and explanation if the score proved accurate. ^* 

The IRF scores could dlso identify institutions with very low scores 

'which ^re doiTig an exceptionally good- - job- in protecting their students from 

) , ' ' ■ ' 

abusfe. Their experience could be instructive to other institutions which are 

' ' %. ^ ' 

. seeking to ^ bring about improvements in their own policies and practices/ Such * 
identification could also serve as- a form of reward for institutions, and . 
consideration cou^d beimade by accreditation agencies for (5ublic recognition 

' or other positive inceiuives. • ^' , - 

^ Finally, accreditation agencies could give consideration to sharing IRF/ 
scoi4s w\th the governmental partners in the tripartite eligibility system who irake , 
decisions based on the accredited- status, of. an institution. Jung et al . . 
(1976, pp, 73-74) recommended that USOE should sponsor an Annual Worki>ng 

, Conference for representatives of the tripartite system to develop a system 

' ' ♦ «> 

of mutual communications based on sharing data, such as IRF s»cores,'which . 



. Theiength o'f this interim period depends on the accreditation status of the^ 
institution; normally, it varies between four and five years, although it may^ V 



. * .be as snort as one year or a? long as ten years 

ERiC ' ' ' , ' -2oe> .23 



would be unique to oTle of the partners but useful \o the others in mak{ng 
decisions which ar? confined to their owrf sph^ere of influeifce. An advantage 
of IRF scores as ci»e subject for such sharing is that, tl^ey.are r^tatively 
objective and standardized in their meaning. They are therefore not dependent 
on thei.incpnsistent definitions, practices, regulations, etc. of any. one agency 
or partn,er ih the tripartite system. < , ' 
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i . APPEND^ A 

« 

Categories and* Examples .of Po^tially Abusive' 

. Institutional Policies and Practices f, 
Refund Pcf^icies and Practices. 



• ■* '^"f?^*il2.°" ^3ve a writlfen refund (policy for -fees or charaes' 

conectetl or _pbli gated irv advance of enrollWt or classltJehdS 



2. Written refund policy is not publicly disseminated to students and 
prospe^ctive .students. • > • • ^ 

3., Written refund -policy does not tell students how to 'obtain refunds." 

4 ' ' - ' ■ 

4. Written refund policy does not provide for at least paHial return of 

IT. T.A °^ ""^'^^ °" ^"^o^^t °^ instruction the student " 

has had the- opportunity to . receiver 

f5. Written refund policy does not'specify the maximum time allowed between 
- the receipt of a valid refund request and. the issuance pf a refund. 

Advertising Practices . ' , , • 

1. Institution uses: • • . . ■ ' 

cSts-"^^"* ■ "^^^P sectiorrof newspapers, pseudo "Talent 

» . ' ' . ^- 

ib\ testimonials or endorsements by actors who did not attend the 
^institution; or 

(c) limited time "discounts," tp attract enrollees. ' 

2. Advertising of the institution guarantees or^'raplies that completion of 
an education or training program will lead to employment. 

3: Institution's advertising implies that it: ' ' ^ • • - 

fact^have-^ or .connections with employers whtch it does not in 

'(b) offers-full or partial. scholarships when ih'fact j.t offers onl'y^loans 
or deferred tuUion^ . . 

- (c) Jf*s recognized experts. on its teaching faculty who in fact have no 
teaching responsibilities; or nave nu 

.,, (d) offers a "superior" educational program when in fact there is no 
. comparative evidence to support the assertion. ^ 



Admlsslort Practices . > 

* * - ^ 

1. Institution employs admi«s*ions representatives whose compensation or 

salary is dependent wholly or in part on direct commissions based on 

number of students enrolled. • ■ * ' ' 

2.. Institution does not, have a written policy governing. recrui<ting and/oV 
admission practices. * . - ' 

• , > * * 

3. -Written recrui.tirg/admissions policy .does not contain: 

(a) any prohibitions agdinst unethical practices sych as the "bait and • 
switch" or the "negative sell"; 

■ . ^ 

«{6). a requirement that all prospective students talk to a representative 
' ''Of the institution at the school prior to enrolling; or 

• .(c) a requirement that all enrollees sign an agV-eement which describes 
coiSplete costs, payment requirements, "and educational services to be 
provided by the' institution. 

4. Institution does not provide remedia,l instruction in?basic skills^or 
students who are admitted without meeting stated admissions requirements, 

Instructional Staff Evaluation Policies ' • 

L Teaching competence is not included as one criterioji in' formal salary 
and/or tenure ancl/or rank review polt(ii€S, • ^ . / 

2- Evaluations of •teaching competence do not include regular, anonymous 
ratings by students, ^ . , 

Disclosure in Written Documents , 

1. Failure to disclose any of the following -.in a-.general catalog, bulletiq, 
or^ot)Ter basic information,. document: -' . 

' (a) name-and, address of school. *^ . ^ 

^ (b) date of* publication o*» the document.- , ' '. 

(c) school calendar'. incTuding beginning and ending dates of classes and 
■ programs, holidays, and other dates of importance. 

(dj a statement of institutional philosophy. * .i' . 

^ (e) .a brief description of the school's physical facilities. 

(f) .^an accurate YUt of ajl courses actually offered. 

(g) an indication of when specific requirgi courses will not be offisred*. 

" (h^ educational content of each course.' - > 

(i) number of hours of instruction in each course arid .length of time in , 
hours, -"'Weeks or, months normally requined for its' completion.'. 



(j) «ii accurate listing of faculty who currently -teach. • • . ' . 

(k) an indication of the distinction betwefen adjimct or part-time faculty 
and Tull-tiine faculty. ; ' . ' • . \ ' 

(1) policies and procedures regarding acceptability*of credits from 
other- ir\^titution?, . 

(ni) gen,er/il acceptability by other institutions of credits earned at 
this'institution. . 

(n) requirements for graduation, _ ^ . ' , . 

(o) statement of certificates, diplomas, orudegrees awarded upon graduati 

' (p) statement of aU charges for which a student may be held responsible. 

(q) financial aid programs actually available to students. ' , ~ 

. 

(r) limitations on eligibility fpr financial aid programs*, 
(s) grading system. 

(t) policies relating to: ' ' ^ ^ 

(1) tardiness ^ K 

(2) ' absences 

(3) make-up work s; ' ^ 
_(4) student conduct . " 

^ (5) termination 

(6) re-entry after termination " 

^(u) student fee increases in excess of $25 that bre planned within the 
next year, ^ > ' - ' 



(v). for student loan apf)licants: 

(T) the effective .annual loan interest rate 
(2) loan Prepayment obligations ' ' . 

_ fSJ loan; repayment [Procedures ' * 

' (4l time allowed for repayment 
{5) deferment or cancellation provisipj^s, if a'ny^ 
(6) col lection. procedures which might Be applied in-the event of 
failure to repay 



In the event any of the following services or facilities are^'provj^ed, 
failure to disclose their,^actual availability and 6xxent: - ' ^ \ 

(a) Job placemept^ssistancle or service. * ' . 

^(b) counseling, irfcluding for employment ^ Academic, apd/or personal ' 
• problems. ' ' - • 

(c) dining facilities. \ ^ ^ 

(d) housing facilities. * ' ^ • . ; 

(e) student parking-facil i ties. * ' , * , , ' 

• . A-3 ",29 ' ' • . - . • 



Admission Practices » ' - 

1. Institution employs admissions representatives whose compensation or 
salary is dependent wholly or inpart.^n direct. commissions based on ♦ 

. numben of- students eni'ol led. 

' i - . 

2. - Institution does' not have a^ written policy governing recruiting apd/or 

admission practTtes. j 

3. Written recruiting/admissions policy '•does not contain: ) 

(a) any probibitfons against unethical practices such as the "bait and 
switch" or the "negative sell"; 

(b) a requijrement that all pro'specti^ve students talk'tp a representative 
of the. institution at the^ school prior to enrolling; or 

(c) ^a requirement, that all enrollees sign an agreement which describes 

complete costs, payment; requirements, and educational services to be 
provided by the institution. . ' • ' 

4. Institution does not provide remedial instruction in basic skill? for 
students who are admitted wjthout meeting stated admissions, requirements 

Instructional Staff Evaluation Policies , ' 

1- Teaching competence is not included as onecriterjon in formal salary 
and/or tenure and/or rank review policies, ' 

1. Evaluations of teaching competence do not include regular, anonymous^ 
rati n^i' by students.. * ' I x . * - 

Disclosure in Written Documents ' ' , • 

h Failure to disclose any of the followtng in a general catalog, bulletin, 
or .other basic information document: ^ ' 

..(a) name and address of school- ^ ' 

(b) date of publication of the document, 

(c) school calendar including beginning and ending dates of classes and' 
- .programs, holidays, and other dates of importance. ' . , 

(d) .'a statement of institutional philosophy?. , ' , " - 

' • - ■ .'--^ ' ' ' ' ' * 

(e) a brief descp'ptiofvpf the school's physical facilities. 

(f) an accurate list'of all courses actually pffered, 

. (g) a'n indication of when specific required courses will^not be offered, 
• ^ (h) educational' Content, of each .coOrse, 



(!) number of hours, pf instruction in each course and l45ngth of ,timVin- 
hoyrs, weeks or months normally required for it5 completion. 



(j) an accurcite lasting of faculty who currently teach. ' ^ . . 

. (kXan indication of the distinction between adjunct or part-time faculty 
* and fulj-'^ime faculty. 

' .policies and procedures regarding acceptabiT.ity of credits frpm 
• other institutions. < ^ • 

^ (m) general acceptability by other institutions of credits" earned at 
this institution. . / * ' ' 



\ 



(n) requirements for graduation, 

(o) statement of certificates^ diplomas, or degrees awarded upon'^graduatipn. 

(p) statement of alf charges for which a student may be held responsvble. 

(q) financial aid pragrams actually available tcJ^tuclents 

(r) limitations on eligibility for financial aid programs. ^ 

(s) grading system. - ^ 

(t) policies relating to: ' . • 

(1) tardiness ' ' , . * r • 

(2) absences . . ^ . 

(3) make-up Work , . - \^ ^ 

(4) student conduct ' . . * . 

(5) termination * . ^ ^ 

(6) r*e-entry after terminatio^n ' / ' 

(u) student fee increases in excess V $25 that are planned within the 
next year. ' ^ ' 

(v) for student loaniappl i'cants: ' ' . 

(1) the effective annual loan interest rate 

(2) locin repayment obligations ' \ ' 

*' * f3) loan i^ppayment procedures ^ ' . • . • 

(4) time allowed for repayment 

(5) * deferment or <:ancellat3on provisions, if any - \ 

is) collection procedures which might be applied In the event of 

failure to repay \ i i ] . . ^ 

In the 'event any of the following services or. facilities are provided, 
failure to disclose their actual availability and extent: ^ 

(a) Job placement assistance or service. ^ . 

(b) counseling, including for employme^nt, academic, and/or personal 
. problems. . ' ^ . 

(c) dining facilities. ' ' * \ 

(d) housing facilities. ' . 

(e) student parking^.faCil ities. ' • ' ^ . / 
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3.- In the event the institution offers an educational program which 
leads to the award of degrees (or -whibh^results in credits which are 
_transfer^b]e toward the award of degrees), failure to provide accurate 
descriptions of: 

: (a) recognition^ by a st§te agency; as meeting established educational 
" standards for granting degrees, if there is such an agency; * 

•• , (b) the scope and sequence of required courses or subject areas in' 

\each degree program L and , '\ ' \ • . 

. C*;^). policies and procedures which students myst follow to transfer 

^^redits wi.thin the institutijDn and/or tp o^e** institutions. " • i> - 

Student Orientation Procedures • ' - * . . ' - 

1. The-institution'does not conducti a formal- orientation program for newTy 
^ni^olled- students. v, ^ , 

2. Failure to include in this* orientation the following: - , . 

(a)* oral^ presentations or written docujients prepared by students?* who have- 
been previously enrolled at the institution.* * ^ * ♦ 

(h) instructions on how and, where to voic6 student complaints and 
grievances. ^ 

(c) information on how and where tp apply for student financial aid. 

Job Placement Services and Follow-Through ' ^ v 

1% In the event th^ institution .cla^flis to have a job placement service, ^ 
this service does not. include the foll:qwing a/^cts: ^, 

(a^ notification of fee charged. If this- is' the case. ... 

\b) formal training in job-seeking and jo{>ht>\ding 'skills/ * - 

(c) * contacting- prospective employers to develop p.g^|ential jobs. 

(d) ^making job^intervyfew; appointments for individual students, including 
, . . ttose s^ekin'g pa/t-time employment and recent graduates. . 

" . ' -* ' ' 

2. In 'the event the institution claims tcPhave a job'placement service, the / ' 
^ service is confined cgily to 'such services a^s (jis'tributing "Help wanted" 

ads. from newspapers or referral to. a commercial placement service^. .^^ 

3. The. ilfstitution does not regularly col l^'ct- follow-up data^on the employmeijt 
y success of former students who^ did not graduate, recent graduates, and/or 

longer term .^ra]|uates. . ^ ' ; 

\. Instritutfon does not annually calculate the rates of student attr'ition. 
from eaGh ^identifiable program or durr'ltulum area and does not attempt 
to determine the reasons for this attrition.' • ' ; 
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nowi/fg4' 



1.. The institution does not maintain the followlffg^it^ms in its individual 
' _ • student records : ' 

• . ■ * ' 

(a) total fees paid bi( the student. . - > 

' ' ' ' ^' * 

' (b) course^ taken and compHetjid . - ' ' 

(c) academic 'credits, grades earned. ' , ' • 

(d) financial'aid amounts, including loans, if any, actually received 

, . . by sttident and date of his/her refeeipt, ■. '. "* 

2. Institution does not have-a written, policy and actual procedures for 
maintain-tng individual student access to records -for a period of at least 
two years following his/her depart-ure from the institution, regardless of 
the operating status o.f the institution. 

Turnover of Instructional^ Staff ^ , ' ' 

'* ' (. ■•' 

1. . Instructional,, staff are repeatedly replaced, in the same sections/courses 

after instruction has begun. ' " ' . 

\ ■ - , ' ' fj 

2. Instructional staff are "replaced in two or more sections/courses after 
instruction has begun.,; 

Representation of Chartered* Approved,-or Accredited Status 

1. The institution fails to disclose to students and prbspectivfr students 
the ,fact(s) of 1 imitation{s) or sanction(s) for noncompliance with ^ 
designated. standards. .imposed by local, state, or federal government. • 
agencie?, if ?fiy exis.t; - ■ — ~"; 

^2. The public representations ^of the institution fail to drstinguil4h 
between (e.g., list separately, with appropriate explanationis) insti- 
tutional accreditation, -specialized or pr;)fessiona.l ' program accreditation, 
state VA-approving agency course approval , and state chartering and , , 
licensing, if any- are present. * 

Financial Stability ' ' ' , 

1. If the iristitu^i'on.is not -pub! icly-supported, it does not'have the- 
' following:' ' ^ • ' ' ~ 

• (a) an endowment or retained earnings funjJ to 'pay current operating , 
• expenses if they are not covered by student tuition receipts. - 

i ■'. -, *» ■ • 

(b) a veserve of funds s'u.ff icient to pay dut tuition refunds a$ students^ 
, ^ jnak-e lepitimate requests for them. . • ., 

2. The institution's financial records and reports are not 'annually subjected 
to a certified^audit. .- ■..» 



L. Instructional Programs in Occupational , Professional Preparation Areil 

1. The institution does hot maintain curriculuni advisory committees which 
include representatives of potential employers in each occupational/ 
professional area 1;of which instruction is. offered. • ' , . 

2. The institution doe? not provide the following, when they are required 
. for employment of^gfraiduates in an occupational/professional area: 

r' (a) special i^zed/pnbf ess. fonal program accreditation. ^ 

(b) training<in use of basic tools and. equipment. 

(q) internships ^nd/or supervised practio^ on t)ie job. - •". . ' ^ • \ 

(d) internshipSi.and/or supervised practice in simulated job situations" 

(e) instruction on topics ^e'a4^ry for state or pXfessional certifi- 
cation of graduates.: - \ - " 

\ ■ 

3. The institution* does not require a biannual review of the relevance 
and timeliness of occupational/professional curricula. 

1. Instruc^tional Equipm^erit and Facili,ties in Occupationa.l/Professional Preparation 

1. The institution does not mjintain advisory committes on Ijistructional 
equipment and facilities which include representatives of potential 
employers in each occupational /professional a»*ea for which instruction ' 
is offered. . ... 

2*. The instiJbtion does' not annually budget and expend funds for replacing 
Worn^or C>ut:datpd instructional equipment in -each occupational/professional 
area i:or-wMch^instruction is offered. ' ' ' •. 
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INSTITUTIONAL REPORT FORM: 



for 



Postsecondary Occupational Training 



Ihstitutioiis /Programs 



developed' by 



The Aijierican Institutes' for Research 
P.O. Box 1113 
Palo Alto, Califorrwa 94302 < 
. (415) 493-3550 ^ ' 




1 September 1.976 



Jhis instrument was* prepared pursuant to Contract 300-75-0383 from tbe'Offici 
of Planning, Budgeting, and Evaluation, Office of. Education, U.S/vD^artment 
of Health, EdU^aMpn, and-lJelfare- Th^ content, however, , floes not necessarily' 
reflect the posiWon or policy of the apGjrts,pr, and no official eitSorsement by 
the, sponsor should be inferred. ' '^ ' ^ 



- , * Introdudtioa Ji ♦ . 

« / / • , / ' ^ ' . . " , >- .i 

This form. is designed to serve as thejasi^ for on-site assessments! of 
the consumer protection policies and practices of postsecondary educational 
institutions. It is meant to be used by officials of government regulatory 
agencies, or by members -of non-governmenta>-accreditati on teams ,in conjunction 
with their inspection visits to institutions which^ar^ eligible for or are 
applying for eligibility fdr federal student assistance programs. The uses 

' of the items in this form and their scoring and; analysis procedures are de- 
scribed in separate users' guides;"' these guides- should b'e studied in detail 

.before attempting any institutional asses^sments. 

Some of the items in this. form%ay be completed on tHe basis of an inter 
view with officials of an i;istitution to be assessed. Other iterrfs require 
that-you acquire and read the institution's catalog, certain writ^ten policy 
statements (if they are availab1e>, and representative advertising, copy. (,if 
jivailable). Depending on the size^of the. institution and it.s complexity, 
completing the^form will take fr:©ffl- under 30 minutes to over/two hours. 

\ 

One, purpose of the form i^ to stimulate an institution's own efforts to 
protect the consumer rights; of its stude nts a nd prospective students. No in- 
stitution is perfect in this' regard. Therefore^ you are'urged to. share alT 
questions with officials of the' iastjtuti6n..beifig.,assessedV~t)vis sharing can 
help them to bring abpu't any ""needed -improvements' voluntar'iiy. " 

* f * • 

.- Each topic- in the form is introduced by a fi-ief rationa}e' explaining the 
nature of the potential abuse it is designee!'^ detect. Wher^ there may be 
questions about the meaning of ►an item,. interviewer^ notes, are inserted. Most 
item response options include a provision for cases where the'ttem is iTbt ap- 
plicable 'to the institution bej.ng assessed; as a'general rule, if "not appli- 
cable" response options are not provided,' and the item does not apply, leave 
the i tem blank. However, omissions should.be avoided whenever possible. 



< Refund Policies and Prabtices \ 



Rationale for this topic: One of the mc^^omorksouroes of; student .complaints 
about postsecondary educational experiences , is iylstitutional ^ failure to refund 
•6uition and fee payments': Institutions are clearly\us^ifiei in requiring - 
advaftce tuition and fee payments and^etdining a portion of these payments to ^ 
cbver processing costs in the /event aU-^dent^withdra^ for reasonable cause'. 
However^ it is generally agreed that ^/L^^institutions should have a written 
refund policy stating^ clearly when and- under what conditions , refunds will be 
^ panted and should make- timely , refunds (without inordinate delay) to atudefits 
who abide by stated insHtutional policy. There, is less\ general agreement 
but sifrong support for ''pro rata'' ^refund policies^ in which students receive a • 
^ ^refund equal in pro^grtion to the percentage of prepaid instruction then 
not receive^ minus a fair amount to reimbuj^se institutional processing costs. 

1. Dols this institution require students' to pay or otherwise obiligate to 
pay any of the following fees or charges iji_^acfvance of enrol Iment or 
class attendance? Fill in one oval for each option. . \ 

No .Yes 

la 0 0 Resident tuition of tuition generally applicable to all students. 

lb Q 0 Non-resident tuition^or tuition paid only by certain groups of ,. 
' " students^ . - " - ' , ' 

' 2c 0 0 '-^Room and board charges or deposits. , . " « • 

Id ^0 "0 Application or registration fees in exce,ss of $50. 

le Q 0 Other requjred student fees in- excess of $50 (excWrfing books). 

If you filled in "no" to all the options above/skip the followTng; three 
items and. go on to page 4, Advertising Policies and Practices. \ 

2. Does' this' institution have a written refund policy regarding all those 
fees for which "yes" was checked in itefh l? Fill intone oval,. 

No Yes . • " 

"0 0 - " • . V . ■ 

If you filled i/i *'no" to item 2 above, skip the following two itejlis and go on 
to page 4-, Advertising Poli<fies and Practices, * ' 



\ 
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3. How is the written refund policy made available to students? "Fill* in 
• ' one oval for each' option. 



3a 
3b 
3a 
3d 



No 

0 

0 

0 ' 

CL 



Yes 

0 

0 
0 
0 



It is made available for publi^c inspection at the institution. 

It is printed' in the school's general catalog or bulletin. 

It is distributed to all enrolled stiidents. 

It is distributes* to all prospective ^.tudents^. 



4, Does this institution's written refund policy specify the folliwing items? 
FiU in one oval for each option, after reading the policy statement. 



No 
4a 0 
0 

4c 0 

y.4d 0 

^4e 0 

. 4f: 0 



Yes 

0 .Those fees and charges whfch are not , refundable. 

^'tf'^^ll^l conditij)ns which students must meet , to obtain refut 

0- How to properly' apply for a refund, 

' 0 A refund formula by>which students pay, in effect, only for 
the instruction they have actual ly had the opportunity .to 
receive. , ' ' * . 

0 '.Any non-refundable application 'processing fee pr^other typjes 
of non-refundable student -fees exceeding $50. . 

0 A limitation on the time al lowed t)etween receipt of a valid 
refund request and the- issuance 6f a rfefund. . . , * 



Rationale for item 4: These are aspects of a refund policy which are desir^ 
able all institutions t)hich collect fees th advance. Students need to 
know when they qualify for a refund and how they must apply for it. Also^ 
, students: 'Should be able to assume that institutions will process valid refund 
requests within a reasonable period of time. Large noyc^-re fundable application 
or processing fees should be avoided and should never be applied without ample 
advance notice tp enrollees and students: ''Pro rata'' tuition refund policies 
are required for veterans reo^voh^ benefits from^ th^ Veterizns Administration 
and are imposed on proprietary^-.Qc}w in some states to curb the use of ''hard 
sell'' techniques by sales represehtj^ives. \ ' 
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^ Advertising iPolunes and Practices 



Rationale for this topic: More and^ more schools are using adverti$ir]g as. a 
^technique to incp^ase enrollments. Abusive advertising oc\urs when false^i, 
misleading J or unsubstantiated claims are made^ whether^^or^not ihe abuse is 
intentional. All institutions which use the public media^ tn attempting to 
attract students shduld be aware that Certain specific practices (whihh are 
in fact illegal in a number of states) involve a potential for abuse. If 
the institution chooses to use them, anyway ^ regulatory bodies and consumers 
should be made aware 'of the fact. Further^ the Chief Executive Off veer of 
~ an institution should be responsible for the advertising practices of that 
institution. If advertising is released without th^ director's review^ espec- 
iaily by personnel who stand to gain frpm increased enrollment^ there is a 
higher probability that misleading kdvertising will result. 

K Doe^ this Tpstitution use the following advertising techniques in atfract- 
ing applicants for. admission? ^Fill in one oval for each option, after 
reading a regre^ntative sample of theJj>5titution's advertising, if pos- 
sible. . , , . ^ 

No***Yer ' ' 

0^' 'e3:assified ads in the "Help Wanted" section of the newspaper, 
^ no^ for employed poisitions at the instfitutiohi but to obtain 
"^ads" on potential students. ' / . . 

0 Corfipetitlons on contests ift which virtually everyone ."wins," 
designed' only to stimulate enrollment's.^ 

0 Testimonials or endorsements by persons who did not, in fact, 
^attend this institution; 

0 Offers of limited time "discounts" on tuition charges, -room 
' and board charges, etc. -, ' , " 

- ' - * - 

2. Does this institution make the following statements in any of its adver- 

' tising? Fill in one oval for each option, afteV reading a representative 

sample of the institution's.advertising, if possible. 

y ' ' ' " - - . 

No Yes pThis institution does no advertising of any type (including 
I professional journal or- telephone directory notices). 



la 


0^ 






Ih ' 


0 


lo 


0- 


Id- 


0 



2q Q Q 0 Completing the education or training 'offered ,at this in 

stitution guarantees employment. - * 



'No" Y6s ' pThis Institution does *no/adverti*sing of .any- type (including 
: ' profess ionar'l journal or telephone ?l1rectory notices). • 

0^ 0 • 0 Completing the education or training offered at this'in- * 
. stitution is Itkely to lead to employment, without pre- 
. ^ senting accurate supporting data. ^ • 

0 • . 0 . 0 There are ties or connfections -J)etwee;) this institution 
■ ^ and specific employers which will result in special em- 
ployment considlr,atiohK for graduates, when in fact there*. 
•* • aS-e no such ties.- . 

^00 0 Scholarships>r other forms of no-cost financial assistance- 
are available, when in fact-they have not been awarded 
during the past year. * 

^^ 0 0 0 The- educational program, is superior to the educational' pro- 
. • gram offered at coifipeting institutions. ^ ^ ^ 

^ 0 0 Recognized 'experts or other types of weW-known persons' are' 
on the teaching faculty, when in fact they have no teaching. 
' . ■ responsibilities. ^ . . 

3.^ Does a responsible administrative "officer of this institution (or higher " - 

administrative level, -for example, district or corporate office) r^iew 
. .advertising copy before it is .released? Fill in one aval for each option. 



No 



Yes pThis institution does no advertising of any typel (Ingliiding 

^ professional journal or telephone directory notUes). 
. n n c«mr. ™«-4. ,'4. ' • . \ 



3a . 0 • • 0 6 Soise or most of it. ' " '. \ 

2b 0 0^0 All of -it. 



Admissions Practices 

6- 



Rationale fov this topic: There is a fine line between innovatii>ej active. 

admissions practices and abusive admissions practices. The lattt^r are^on^ 

of the most frequently cited topics of student aomplaintSj yet active recruit-^ 

» # •- 

ment'is becoming more and more essential for institutional survix^al in this 
time of declining erfpollments. The present topic area attempts to inquire 
about techniques which have a high potential for causing abuse y, as judged bxf 
carman senses recent literature j and' documented student complqints. 

Does thi^s Institution employ admissions representatives whose compensation 
or Salary is based wholli' or in part on commiissions? FilKin one oval. 



♦ « 


No 


Yes 




■• ^ la 


0 


0 , 




If y(S^ filled 

« 


in "no" to item 1 abave, sk-ip item 2 and go on to iiiem 3. 


9 


How 


t 

are these commissions calculated? Fill intone oval for ecth option. 




No 


Yes 






0 


-0 


They are based on the number of students enrolled,* 




0 


0 


They are based on .the number of students enrolled who actually 
attend classes. * ^ 


• 2a' 
> • 
* 3. 

• 


0 . 


0 


4iThey are basecl on the number of students enrolled who graduate. 


Does 


this 


instituti'on have a written policy wf>ich governs recruiting and/or 




admissions practices?* Fi31 in one ovaL ^ ^ ^ 


V 

« 

3a 


•No 
0 


Yes 
0 





If you. filled in "no"* to item 3 above/'skip item 4 and *go on to item 5- 

4, Does this ifistitutiqn's written recruiting and/or admissions policy specify 
the fonowing*"i.tems? Fill in one ova-l^for each option, after reajd.ing the 
' pal icy statement.' , • - ; , , 

. No Yes , ' ' . ' 

4a 0 0 • A. code of ethfcs wMch prohibits* certain recrui ting/admissions 
practices-. - . . 
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No 
4b- 0 



Yes 
0 



4c Q 0 



A requirement that prospective students talk to a staff member, 
at the institution, prior to enrolling- 

.The completion of a signed enrollment agreeirfent which describes 
costs, payment requirements, and educational^ services to be 
provided by the institution- 



; 5. *Dbes this institution have a policy of regularly admitting students who 
^ ^ .do not meet stated admissions requirements? Fill in one oval. 

No Yes ^7^*^^*^ institut:fon has no stated admissions requirements- 
5a. ^ 0 0 . ' ■ • . . 

If you filled in "no" or "no stated admissions .requirements" fo item 5 above, 
skip the following item and go on to pageS, Instructional Staff Evaluation 
Practices i 

.6r For students who do not m§et stated admissions requirements, but are ad- 
mitted under a special^ admissions* policy, are the following courses pro- 
vided? Fill in one oval for each option. 



No 
6a 0 

t. 

6b \ 0 
6c 0 



Yes 
0 

0 

0 



Caurses or sections offering remedial instruction in basic 
English- - ' ; * • ' 

Courses or sections 'offering remedial instruction in basic 
mathematics. \ « 

• 

Special academic tutoring programs offeVing remedial fnstruc- 
^ion reTiited to ^students' needs. 



Rationale for items 5 and 6) If an institution ^has an essentially "open^' > 
admissions' policy then it should a^o have remedial ^services id assist stu^' 
dents who may he underqualified. Aailure to. do so may he tdl<,ing^ unfair advan- 
tage of underqualified students in the pretense of ''gibing them an opportunity. 
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Instr^ictional Staff Kvahiation Practices 



Rationale for' this topic: Unqualified and unmotivated staff provoke many 
student complaints; but the determina.tiori of staff gualifications and moti- 
vation^ like the ^determination of quality^ of educational program^ is prob-- 

lematic and beyond the scope of this form.^ However^ there, avveav to he^ certain 
steps which can be taken to 'Evaluate and improve instructional staff. All 
institutions should carry out such steps as a matter of institutional policy* 

Is teaching competence (no matter how it is evaluated) included as one 
criterion in the formal salary and/or tenure and/or rank review policies 
of this institution? Fill in one oval. 

No Yes- pThis institution has no formal salary/tenure/rank review 
policies. 



la 0 



0^ 0 



2. Is teaching competence systematically evaluated by the following grpups 
at this institution? Fill in one oval for each option. 

By administrative staff. 

By other faculty of the same department or program, 

f> * 

By students- ' , ^ - ' 

By graduates . ^ - 

By 'self- ratings. . ^ . * 

Other, please describe on the fast page of-the questionnaire- 

If you filled in "no" to "by students" in Item 2 above, skip the -following • 
two items and go on to page 10, Disclosure in Written Documents. 

"3. Are students evaluations of teaching facuTty members conducted on a regu- 
lar basis (for^example, yearly, at the end of 'each course, etcl? Fill 
in 'One oval. 





No 


Yes 




0 


0 


2b 


0 


0 


2c 


0 


0 


24 


0 


0^ 


2e 


0 


0 


2f 




0- 



No Yes • ^ : . - • 

'3a 0.0, ' • ^ * , ■ . • 

If you filled in "no" to item 3 above, skip the following' item and gg on to 
page lOV Disclosure ifi Written Documents. ^ 



4. Does the system of evaluation' of . instructors by students include the 
•following provisions? Fill in one ovkl for each option. 

• " No . Yes /. ' 

4a 0 0 Anonymous student responding. - v 

0 ' 0 . * "Objective student; i^spondijig (for example, on- machine 
, scored answer sheets). • 

^ 0 0 ' Evaluations of aVL full-time faculty members. 

r-There are*no.part--Cime faculty members. 

0 0 '0 Evaluations of all part-time faculty members (for exampl 
adjunct faculty members)." ■ ■ •• ■ . 



i 1 



'44 



B-9 



Disclosure in WritteiJ Ddcuments 



\^tionale for this toyio.r .Lack^of adequate disolosio'e by an institution can 
be intentional ov unintentional, If4t is intentional and students a^e misled 
as m result, the r48ult> is Qonsumer fraud. Much more Qormon are sipttation^ 
in which look of adequate dvsolosure is ' unint^ntidnal, and students wake impor- 

. tant decisions based on faulty or no information: Student anger when the true 
facts become known is .no Uss justified under these circumstance^ tha^^under ' 
oircmstances of intentional fraud. All institutions should, as a r^utirie . 

. policy, disclose certain ^mportdnU facts, both to prospective enroUeesrand ' 
already enrolled students, ^or should students have to exert unreasonable 
effort to seek out tkese.'facts; they should be written clearly, in comon ' 
English, and handed, free, to all. ' ' _ 

Interviewer note: 'The items below do not ask whether par.ticular conditions' . 
or services exist at the institution, but whether their existence or non-exis- 
'tenoe is adequately disclosed in public documents. - . " ' 

• . ' > •••'* ' • ■ 

1.. Does' this institution disclose information on the following topics in its., 
-geaeral- catalog,- bulletin, or basic public information document or a com- 
. liination of these?. Fill intone oval for each- option, after reading the ' 
appropriate documents, . \- • ' , 

y Name and address of school. 

Date of pufaXication of the document. ' , ' 

School calenBfir including beginning and ending dates of classes 
• and programs, holidays, and; other dates of importance. - 

A statement of institutional pJ^ilosophy and program objectives. 

B brief description -of the sch?)ors physical facilities. 

An accurate Tist of*al.l courses actually offered, or all sub- 
ject areas actually taught if separate courses do not exist. 





No 


Yfes 


.la 


0, 


0 


lb 




.-0 


Ic 


0 


o". 


Id 




0 




,0, 




.// 


0 


0 


is 


0 


■ 0 


Ih 


0 ■ 


0 



An indication of when specific required courses^will not be 
offered. " ' • ^ 

Educational content'of each course, or of the program if sepa- 
rate courses do not exist. - , 



H 

Id 
Ik 

n 

Im 

In 
lo 

lip 

ir 

Is ' 

It 
lu 

IV 

iw 
Ix 
■ly 

2a. 



No 
0 

a 

.0 

0 

0 

0 
0 
0 

0 

0- 

0 

0. 

0 

0 

0 

0 

a 



Yes 

0 

0 
0 

0 

0 

0 

0' 

0 

p 

0 
0 

0 
0 
0 
0 

0 



Number of hours of instructibh in, each course, ^or in the prb- 
'gram if separate courses do not. exists and lerigth of time in 
hours, -weeks^ or months normally required for its completion- 

An accurate listing of faculty who currently teach- 

'An ind-vcati'on of the distinction between adjunct or part-time 
faculty and full-time 'faculty (ifthis distinction doe^ not 
exist at this^ institution, fill in '"yes")- 

Policies and procedures regarding a^cceptabtlity or non-accepta- 
^bi1it;y of credits from other institutions- . ' 

General acceptability or non-acceptability by other institu-- 
*'tions of credits. earned at this institution- ' * 

Requirements for graduation- ' . 

^Statement ^certificates or diplomas awarded upon graduation-- 

Notice of al2 charges ^or which a student may be held raspon- 
sibTe (if no charges exist at this institution, fill'in "yes")- 

Financlal aid programs actually available to students, or in- 
structions ori how to obtain such' information-' 

'Limitations on eligibility for financial aid programs, or in- 
structions on h.ow to obtain such .ini'ormatiQn. 

Grading system, ^ . • . 

Policies reletting to: . , 

Tardiness ^ . ' - • ^ ' 

Absences ' • , • 

Make-up work-. 

Student conduct ' • ^ , . • 

Tennina:tion ' - ^ ^ 

Re-entry after termination ' \ ^ ' 



ftai 



If there are any standard limitations on post-training employment oppor- 
Canities for students at this institution (for, example, medical or health 
requirement?^ professional 1 icensing requirements, apprencticeships, age, 
experience, further train^ing ^y ^fem[?loyer, etc-), aiee these liniltations 
disclosed in the basic public in^formatibn document(s)? FilKin one oval - 

Yes 



V . 



No 



2a2 0 ' 0 



r There are 'no standard limitations on post-training employ-, 
ment opportunities for students at thi-s institution. 



ERIC 
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*2b* If this instHutlon lacks specialized or 'professional course accredita- 
tion which is required for post-training emp'loyment of students, is. this 
' lack disclosed in the public information document(s)? Fill in one pval . 

0 '^^^ ^^^^ 0/ specialized accredj^tatlon is nojt disclosed. 

0 The lack of specialized accreditation is^ disclosed- 

Q Specialized or professional course accreditation is not re- 
■ * > quired for post-tra/nj^ng employment 'in any of thevcourses of 

study offei^d^at this .Institution, or all courjses requiring 
' specialized accreditation are so accredited. 

2c. Does this Institution provide accurate description's of the availability 
and e)(tent of 4^e following student services in its basic public infor- 
mation document(s)'? Fill 'in one oval for each bptioil. 

* No Ye^ ^No service of this, type exists at this institution^. 
2a 0 0 0 Job placement 

^ 2od 0 0 0 Student counseling - „ 

2a^ 0 0 0^ dining, facil ities (for example, a student cafeteria. Do 

not count vending machines.) * ■ ^ ' \ 

2cf 0 ^ 0 0 'Housing facilities , ' ' ' y . ^{ ^ 

2Qd 0 0 0 Marking facilities 

Note: Items 2h^ 2i^ and dealing with degvee-^granting practices ^ ^^f* * 
omitted from this ^fovm. 

\ 

3- Are- increases, in any si^udent fees in excess of $25 currently pla/ined to 
occur within the next year? Fill in one oval. 

No Yes • '* . ■ . 

3«\0 0 . ... • 

If you filled in "no" t'o"item 3 above, skip item 4 and go on to item 5. 

4. Are the planned fee increases disclosed in writing "to all students and 
prospectiv.e enrollees tO\Whom,.they mi^ht apply? Fill in one oval. 

No % * - ^ ' ^ 

4a.- 0. ' 0 ' . . ■ ■ ♦ 



. 5. Does this institution make student loans, -either directly from the , insti- 
tution or as a lender for one of the federaf or state student loan pi^Or- 
gramsT Fill in one .oval • , ^ 

No Yes > . * - ' * . ^ ^ 

0 ' 0 ' ' . ' ' ' r\' ' ' 

If you filled in "no" to item 5 above, skip the following item and go on to\ 
page 14, Student OK^ntat ion Practices. , 

' 6'. Do all applicants for student loans ( excluding , short-term' or emergency 
' loans) receive printed documents from the institution which disclose the 
• f61 lowing, before any repayment obligation begins? Fill in on^ oval for* 
each option. ' ' ^ . . ' ' 

No Yes ' ' ' • , ^ 

0 Q The effective annual loan interest rate. 

0 0 Loan repayment obligations. ^ 

5c 0 P , The process for repayment of fhe l<jan.- 

• 6d ^ 0 ^ The length of time allowed for repayment. • 

6e 0 0 The procedure for renegotiating th^ ^repayment schedule for 
the loan or deferred fees. ' . * 

6'f ^ 0 Pr^ocedures for «deVennen't or cancellation of portions of the ^ 
loan or c!^ f erred fees^ if necessary/ ' * * 

6g ^ 0 Procedures for loan or deferred fee collectiqn which will be 
used in the event of failure to repay. 



. ' student Orientation Practices 



Rationale for this topic area: InsHtutions Tfiave a responsibility to engage . •• " ' 
in oer^in affirmative student orientation prdatioes^. to .insure that newly. ^ ? ' 
erirolled students' are aware of . their r^hts and resppnsiUUties . ' fhe orien- 
. tation should especially include presentations by students who hccoe been en- ••. 
. rolled previously, so, that they can share their experi'enaes and aaquiz^ed " * 

. knouledge of the practices and policies of the institution'. ■ ' • .\. 

- " > * , ' 

^. . Does this Jnstitution conduct a program of Qrientation .for incoming stu-' ] 
dents? Fill in one oval. \ • ' 

,No ' Yes . • 



v.2a 


0 


0 




If you filled in '^n'o"- to item 1 above, skip the following item and go on to . 


page 15, Job Placement Services and Fol low-Up 6f Graduates. 


2. 


'Does, 


tiis 


student orientation include the following? Fill in one^'oval • ^ 




"for j 


option. ■ , * 




No- 


Yes 




. 2a 


0 


^0 


An orientation newsletter or. student handbook. ' 


2b 

. i 


0 


0 


Oral presentations or written documents prepared by- students 
whb have attended the institution recently,, '. . ^' 


20 


.0 


0 


Instructions on how and w"h^e to voice complaints and griev- " 
ances. <^ - - • 


2d 


0 


.0 


Instructions on' how to obtain information on available student 
financial a.id". ' > ■ 



Job Placoment Services and Foil6w-Up of 6raduat)&s 



Rationale for this topic arear Two relatid topic areas q^e actually^ covered" - 
here. \ If institutions do not claim to^ offer placement assistance^ it 'is of ^ , 
coursre not mandatory that they do so. )[f ^placement assisl^rj/pe i^offered^p^^^^ 
it should consist of certain essential services lest it be nothing .more than 
a shoddy sales gimmick*. Regardless of whether or riQt placement assistance • 
is offered^ follow-through '(or follow-up df graduates and 'alumni/ is essential 
08 a method for evaluating the relevance and effectiveness^ of a/n instvtution^s 
educational programs* Sampling and new student follow-up tecl^ques make such 
'follow-through a possibility for alt institutions. . 



1 



Does this institution state that it offers job placement serviJ^ or other 



^ placement assistance to, students 4n finding jobs? ' Fill in obe" vaK 

No Yes ' ' . ' \ ^ ' ' ^ 

la 0 ~0^' I' '^-"f ' . ' ' : : 

If you filled -irt "no" tb'.ileni*l abova^'skiFr^Ueni 2 and qo on to item 3. ... 

2l» D^es the . piacemejit ass 1 stance* of fered-fay tlii^s* institution inglude the fol- 
I'ovHng 'aspect§?. Mll^ in one oval for^ath optidn. • , , 

No 



. 2a 
2b 
2o 

2d 
.2e ■ 
2f 

2g 

2h 



0 

0 
0 
0 
0 
0 

0 



Yes. 

o" 

0 
, 0 

0 
'0 

0 

0 



A fee for*1fH#^assistance. 

Formal trainirfg in -jotf-seek^ng iand/^b-holding skills. \ 

Seeking out and/or (aj|it3.ctinV pro's ^gipttve employers. 

Making job interview apppintmfhts' far. individuail 'st^^^ 

Referral to a commercial, placement service which^ charges ^ a fee. 

CoUation.and distribution^of vHelp^Wanted" Sids from newspapers 
as the only <placem^ as'S>^tance ^dffyed. • . . 

AssistanceMn finding part-tfi^ jobs; * ^ . ;\ \ ^ 

Other, please describe in the space pr-ovided at the end of the'' 
form/ : ^ 



'Rattomle fov iourj :J: Genuine^plaaement assistance or oewiQe» performs at > 
least the minimal funKJtioni: of job ^development (aontaating pnQs]^^ive em- 
ployers regarding possible openings)^ training in job se^ekin^ and niaintenanoe 



skills^ and scheduling interviews for students, fo^^otH part-time and full- 
^time jobsi Any placement assistance or service which does not perform these 
functions is in danger of I'eing a charade y . and calling it "placement^' is a 
potential abuse. . - 



Does this institution systematlfally collect data on the employment suc- 
cess (however defined): of persons in its occupational or professional 
preparation programs? Fill in one o^al for each option* 

rThis ihstitution currently has nonoccupational or profes- 
sional preparation students or graduates* 

Q Former students who did not graduate* s 

Q ^Recent graduates~(wi tTiiri one year of graduation)* 

0 Recent graduates (within , five years of graduation)* . 

Rationale for item 3: ' Ulth the, efficiency of modern sampling and* follow-up 
teohnCcjueSj even lack of a large budget is no excuse for not trying to collect 

som^'jiata on t/e ultimate 'desired outcome of occuvational or professional prep 

— 4 ^ ' - ^ S 

oration pvogrtms — employment succesf 





No 


Yes 


3a 


0 


0 


3b 


0 


0 


3a . 


0 


0 



3^. 



4. Does this^ institution systematically collect data on the numbers and char- 
acteristics of* students who drop out idY the school 'at the time they leave 
or soon thereafter"? Fill in one oval fqr each option* 

No Yes^ ' . - ' 

4a Q 0 For all students enrolled in occupational or professional prep- 
aration, programs or majors*,. . 



4b 0 O 'For' all enrolled students regardless^f program or raajor. 



Recordkeeping Practices 



Rationale fov this topic: Ins-^ituiions which do not adequately maintain stu- 
dent vecov48, in a central locai%on make it extremely difficult fov current 
and former studeni^^to access them when there is^a need to 'do so. Moreover^ ^ 
if an institution should cease operationsj^ look of a record maintenance policy 
*can cause great inconvenience and even abuse of current and former students^ 
who are unable to secure necessary proof of their past education* 

1. Ace individual student records maintained which contain the foTl-owing 



items?/ Fill in one_ oval for each optibn. 




la 0 
lb 0 



la 0 
Id . 0 

le .0 



if^ 



Yes 
0 

0 



0 
D 



l!o fees are charged by.thts institution, 1 

Toixil tees paid by the student. 

Courses- taken and completed or subject matter covered by 
the student. * 

No internships or supervised practice are offered by, this 
institution. ^ \ ' 



•0 



Internships or other forms supervfsed professional 
* ' practice. ° . 

Academic^rec^its, grades^, or indicators of satisfactory 
' progressfearned by the student. ' ^ ^ 

^-Ijo financial aid' is offered by this institution directly. 

0 Financial aid, amounts, including loans received by the 
student directly^from the institution, if any. . ^ 

Othec, please describe in the s|Dace provided at the end 
^ of the for|i. ^ ■ _ : _ 



2. Does this institutit)n havsi, a wr ^ten policy for mat ntai ni nq^^^^arrangi ng 
for mTintenance of individual studen^t access to records for^HPbriod of 
at least two years in the event of a school closure' qr change of control? 
Fiji in one oval. ' ^ • ^ ' - 

Np Yes . ^ \ ; 

2a^ 0 ^^0 ' ^ ^ . * ' — : . ^ 
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Maintaining Stability of Instructional Staff 



Rationale for this topic: One^of the most disturbing educational experiences 
is the turnover of instructional staff diadng a course. Each tumpver causes 
extreme disruption and loss of essential continuity. Furthermore ^ excessive 
staff instability is a probable indicator of deeper troubles in an institution. 

!• During tlie previous calendar yeiff , how many tifnes was there an- unscheduled, 
permanent change of instructor after . .instruction had begunXt?^ r?3?OQ5 . 
other than illness or death of original Instructor)? Fill in the number; ; 
if none, enter as . zero, 

la Number of timeS: " 



Z. This represented what percentage of the total numb^of instructors teach- 
ing during that calendar year? Fill in the percentage; if none, enter'as 



< 

zero. 



2a Percentage: 



.3, During the pi^evious calendar year,^did arr^ unscheduled, permanent change 
of instructor occur in the same course or subject area twice or more often 
after instruction h^^begun? Fill in one oval, ' * ^ 

No- Yes Vy^ 
5a 0 ,0 ^ 



/ 

l^epresentation of Current Approved or Accredited Status 

Raticmle for this' topic: Students should be aoourately informed about the 

^ ^ \' ^ ' ' ' " ' ' ' • 

actual status of an institution or its programs with' regard to state or vet^ * 

erana approval^ pi^ivate Ziccreditation, and any ^eriding legal actions^ It is 

.the responsibility of the institution to provide and not to misrepresent 'this 

irifomation. Misrepresentation is a subtle abuse which may cause, students ^ to 

believe an institution has been evaluated and approved, whet} in foot it has 

not been. . * * , * . 

1. Is this i^nstitution^cucjrpnfly oh syspension, probation, /t)r some other 

form of limitation or sanction for noncompliance with designated standards, 
by. any of the- following government ifgencies? Fill In one oval for each 





option. 






No 


Yes 




la 


0 


0 


( * 

A local government afgepcy (for example. Consumer Protection a 
Agency, District Attorney, etc.). 


lb 


0 


0 

c 


A state government agency (for example, Sta^e Approving or 
Licensing Agency, Attorney -General , etc.). 


la 


0 


0 


A federal government agency (for example, federal Trade .^om- 



If you filled in "ng" to all of the ae^ve options, skip item 2 and go on .to- 

item 3. . • ' • • ^ 

\ ^ - — * 

^. Are the facts of the above limitation(s) or sanction's) publicly ^t'sclosed 

to enrolled students and prospective" students? Fill in*one-^oval for each- 

< ♦ 

• option. 

• 'No Yes " ... ' , s m . \' 

2a 0 0 In prifted form .to all^ enrolled students. - . - 
22? 0 0 In printed ?orm to all prospective students-.' 



■ • ■ / ; ■ ■ . - 

3/ Do the public reF(i;esentations of this institution cleaHy indicate (and 
• distinguish between, -where applicable) institutional , accreditation, spec- 
- ialf^ed or professional program accreditation, state VA-approving agency 
• .course approval . and state licensing and approval?. Fill-in one oval i after 
reading the. public information documents of jfche institution if possible. 



No, Yes 

3a 0 ' Q' '0 



Not Applicable. 



r 



Jinanoial Stability 



Rationale for this topic: As many regulatory bodies have discovered too late^ * 
it is very difficult to either measure or guard against financial insiabitity 
. in a ^post secondary institution* However^ obtain praoticHs are more likeHy \ 
ihan 0thers t6^^%nsure that institutions do^ not close dom^ leaving students 
with no recourse .'^ Regulatory bodies should knov) about these practices in' 
institutions for which they are responsible; consumers should also ber aware 
of these practices. , - t . , " ' ^ 

> * * » • • * ( 

1.^ Are the central financial records and reports^of this institution ^regu- 
larly subjected .to -the foil ovring audits or Inspections? Fin In one 6va1 

for each option^- - • * ' ' • - 

« 

No Yes ' ' • . ' 

la 0"^ • 0 ■ Uncertified audit 'by an accounting firm.^ 
lb 0 * n""^' Certified audit by an accountirfg firm. ; 
lo 0^ 0 Inspection by a- state r*egu1atOFy or auditing agency. • \ 

Id Q inspection by a federal regulatbry or auditing ager>cy. . .. 

Zr' Is this a pub1icJy-suppor,ted institution (that is, over-5D% public fund- 
ing)? Fill in'one x)val. - - * / • 

No , Yes " ; • " ' , 

2a 0 . 0- . . • ••- ' ^ , 

Jf you filled in "yes" to item 2 above, skip the foil owing -four items and go 
on to page 23, Occupational Iprstructional Prpgrams. " [--v,^ « .• 

3. Does this insti-tution h^ave an ehdowment, retai-ned earnings fund,, or other 
reserve of funds Qr income to pay operating^ expenses not 'covered 'by current 
• student tuition receipts? Fill in one oval. . r . ^ . , . 

, No Yes ■• ' - ' . . • * - • • , 



3a' 0 0 



fi 
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4. Do the financial reporting practices of tliis institution report unGollected 
. • tuition as- assets'*, withou.t .indicating an offsetting liability? Fill in 

» 

one ova] after looking at a current financial statement, if-possible. 
lo Yes^ ^ '• - ' 

4q 0 -0' ' - * \ . 

5. Is this institution currently engaged in bankruptcy proceedings, or is 

. there any serious possibility that it iftight enter into bankruptcy proceed- 

- ings duHng the \pext 12 months? Fill in one oval. ' * . - » 

^Ho Yes - • ■•\ . ' ■ ' 

If you filled in "no" to item 5*above, skip the following item and go on to . 
page 2 3» OdcilpationaJ Instructional Programs. ^ 

6* Does this .institution publicly disclose information about bankruptcy prov 
ceedings' that -are underway or planned? Fill in one oval for each option. 

^ No , Yes ' ^ ^ 

6a Q 0 ' This infbrmatio'n ^s disclosed to-all enrolled students.' 
6b Q 0 /»This information.' is disclosed to aB^ prospective enrollees. 



I ■ ; 
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Occupational Instructional Programs 



'Rationale for this topic: There is no intent *in this section to, gather indi^ 
cators of the "quality'^ of an institution's instructional program. Tjiis is 
a oomplioated tosh better handled by the accreditation or approvaljprocess . 
The intent of this section is to gather descriptive' indicators of institu^ ^ 
tioml practices which are viewed as 'essential for tHe maintenance and imprpve^ 
ment of quality. In the occupational/vocational program area^ studentd^(and 
employ ers)^ generally expect training po result in certain very specific skill 
outcome^. If the institution does not take definitq^ steps to see that these 

"outcomes are achieved in it§ graduates^ it is in danger of malpractice. We 
have no definitive catalog of^such steps (if we did^ we would start a school); 

,we hccve included pvgatioes about which theri is general agreement. ^ 

\. Does this irtstitution maintain and utilize advisory committee(s) on cur- 
riculum content? Fill in one oval for each option. 

' No Yes • ^ - 

la 0- b For some of the occupational/prrofessional preparation program 

areas offered at this institution, • ' j ' ' : - ^ ^ 

\. \ 

JZ?. 0 ' 0 f^o^ occupational /professional preparation program areas 
offered at this -institution. 

If you filled in "no" for 'both options, taitem 1 above, skip i.tem 2 and go on 
to item 3** ' r 

Rationale for item Ir Institutions lacking such advisory bodies tend to, in- 
sulate themselves and their curricula from current practices^ and, technology 
in business^ industry j ttnd government^ and in so doing they ^j^ppardize the' 
chances of their students -for -placement in jobs appropriate to the type of 
training which they have completed* ^ T' • . - " - 

2. 'Do'the§e committee(s) include representatives of potential employers? 
Fill in.o^ oval for each option. • • * ^ 

' . No Yes , , " 

2a >0 0 Tor some of. th^ ocpupational/professional preparation pr^ram 
areas offered at tMs institution/' , 

2b 0 '0 ForVr[ occupetio'nal/professionarl preparation program areas ' 
'offered a-t^his institution. ■ ^ ♦ ^ , 
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3. Do all; of occupational/professional preparation programs, in t*his. institution 
possess' specialized/professional accreditation ^, i'f this ^Is a requirement 
) foV the employment of graduates in those occupations or professions? 
. Fill in one oval • ' ^ , 



3a 



Ho Yes p-Specialized/.professional accreditation is not required ^ 

X for any position in any occupation or profession for 
^ y ^ which this institution provides preparation. ^- 



4* Do aJX of 'the occupational/professional preparation programs in this in- 
stitution provide sufficient training in the use of basic tools and equip- 
. ment, if this is a requirement for the employment of graduates in those 
occupations or professions? Fill • in one oval • 

No Yes I — Training in the use of- basfc tools and equipment is not 
y r\ n n r^SMllM'^o^ position in any^ occupation or profession 
^ ^ y ^ for w(;iich this institution provides preparation, . . 

5\ Do a>l of the occupational/professional preparation programs in this in- 
stitutibn provide for internships and/or supervised practice on the job , 
i*f th^is^is a requirement for the employment of graduates in those occupa- 
• tions or professions? Fill in one, ovaL 

fio Yes- r — ;Interhships and/or supervised practice on the job are not 
* Q n rj required for any position -in any occug^^t^ or profession, 
^ ^ • ' c for which this institution provides preparation, - * 

6, Do aVl of the occupational/professional preparation programs in this in- 
stitution provide for. internships and/or supervised practice in simulated 
Job situations > if this is a requirement for the employment of graduates' 
jn those occupations or professions? Fill in one oval . \ , y 

.No Ye^ r — Internships and/or supervised practice in simulated job 
p. n n situations are not required for any position in any occupa- 
U U tion or profession for which this institution pro.vides prep; 
aration,- • 



f 
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7. Po all of the occupational/professional preparation programs In this in- ' 
stitutlon provide for Instruction on topics necessary for state or prof es- 

' sional c&rtlfication Irvthis state , if such certification is a requirement 
for the employment of graduates in those occupations or professions? Fill 
In one oval . • - ■ , 



No Yes pState or professional certification in this^ state is not 
n ' n x\ required . for any position in any occupation or professior 
^ • ^ for which this institutiop'provides preparation. 



8. Does ttiis institution require reviews of the relevance and timeliness of 
all of its. occupational/professional preparation curricula once every two 
years or more frequently? Fill in one oval. 



No Yes *■ 



■V. 
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. Occupational Instructional Equipment >and Facilities 

Rationdle fol* this topics area: Some schools impose outdated or iifiproperly 
functioning eqilipmeni on their students • This affects how adeqiXately gradu- 
apes are prepared for employment once they complete their instrudti^aj^pro- 
grams. Some schpols start new p^bgirams but fail to purchase the amount and 
type of equipment needed to run the program. Both types of pract:ice are ^ 
abusive. - . ✓ ' * 

1. Does this institution utilize advisot^ conwittees^ on instructional equip- 
ment and facilities? Fill . in one oval . • * * ' 

' -No ^Yes . , ' ^ 

2a 0 ' 0 ^ . ^ ' ' . ^ 

If you filled in "no" to item 1 above, skip item 2 ind go on tO' item 3. 

2. Do, these advisory committees incVude representatives of potential employers? 
■••^'Fill in one-oval f^r -each optton. ---- * - - 

^ No Yes ' € ' • . ' . ^ • 

2a 0 'b ' For some o^ the occupational /professional preparation programr aneas 
offered at this ^institution. • ' 

2b^Q 0 * ForSall occupational /professional preparatitfn program areas offered 
.at rhls institution. . * ' , 

*o \ • , 

3. Does this institution "a-nnually expend sufficient funds^for replacing worn 

s or outdated instructional equipment (including lab. and other non-classroom* 
equipment')? Fill in, one oval . - ' - • ' 

, No Yes . ' 

2a 0 0 • ' ^ • ' ■ « • 

4. . Doer%t'his institution annually expend fupds for new instructional equip- 
ment' (including lab. and other non-cTassroom equ^ent) sufficient to m^t 

prpjected program needs? Fill in one oval. ^ ^ ' 

' •* ' . • ' - > ■ 

No Yes • , • . 



Addilloiial (]oinftion(« 



Please write additional comments in the space below. If you are commenting; 
on specific items/be sure to include the section and item number. 



Section ar>d f 
Item Number 
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APPENDIX G ^ . 

'Modifications to Occupational Training 
' Institutional Report Form for Postsecondary 
• Degree-Granting Institutions/'Programs , 

. . . ■ ^ ' ■.. 

!• The following items are added to Xhe section on Disclosure in Written 
Documents on page 12. , \ ^ > 

Does this institution provide .accurat-e descriptions of the following 
' ' institutional conditions or procedures regarding the award of degrees?' 

Vpc Nn 

'""^ '^"^ ^ — No State agency exists for thi^ purpose. 

2^ 0 0 Q Recognition by state agency as ineeting established eclucational 
standards for granting degrees. ^ ^ , - 

2i 0 0 - Scope and sequence of required courses or subject areas in 
each degree pr;ogram. * - 

^ '——There is no tjransfer between departments and/or colleges.' . 



2j 0 0 0 Policies and procedures regarding transfer between departments 
and/or colleges within the institution. ' ^ 

2. The sections on Occupational Instruction Programs and Occupational 
Instruction. Equ^ipment and Facilities (pages 23^26) are removed. 



■ APPENDIX D . "» 

IRF Coding, Editing and Weighting Specifications 



( 



Field NmmI Length 



School 10 t \] 



Raw Line/Bytes 



Merged Bytes 



1/1-11 



1-11 



Topic 1 - Refund Policies §nd Procedures 



Items la-le 


5 


1/12-16 


12-16 


Item 2f 


1 


i 

1/17 


« 

17' 


I terns 3a- 3d 
Items 4^-4f 


* 

4 
6 


1/18-21 
r/22-27 


t 

18-21 
22-27 






4 





Tog1c2 - Advertising Practices 



' Items la-Id 
Items 2a-2f 
, Iteflts 3d-3b 



l/»r31 

1/32JC7 
^ 1/38-39 



Top 1 c 3 - Adml s*s 1 ons Po 1 1 c l^s 


Item la'^ 


1 


^ 1/40 


Items 2a-2c 


\3 


1/41-43 


ttem 3a 


1 


1/44 


Items 4a -4c 


3 


' ^1/45-47 


Item 5a 


1 


1/48 



28-31 

32-37' 

38-39 



Items 6a-6c 



ERLC 



1/49-51 



40 



41-43 
44 , 



45-47 
48 



49^-51 



Coding and Editing 



bytes; state city code (geographical 
• K region) ^ , ' 

\ 01 * San Francisco 
1 02 » Los Angel es p 

^' 03 » Minneapolis 

04 « St. Paul \ ♦ • 

05'- Kansas City 
06 - St. Louis 

byte 3 ownership status 

1 ■ publ4c ^ , ^ 

2 ■ private, non-profit, non- 

religious aff14»1ated - 

3 ■ private, non-profit, reli- 

gious affiliated 
^4 ■ proprjj^tary - 

byte 4 school type • - i 
1 ■ occupational/vocational 

programs lonly 
2*« 2 year degree-granting with 
some occupational/vocation- 
al^ ^programs > 
3 » 2 year degree-granting with 
^ • no occupational/vocational 

""prpgrams ^ 
4*4 year degree-granting (may 
or qiay not include occupa- 
tional/vocational programs) 

yes- ■ 'r, no ' 'O/, no response ' '9' 

'-If none are markefe, code '9' to all * 

2a*4f and go to tqadc Z 
-if all la-le are NOAcode 'B'to^all. 

2a -4 f and g6 to topic 2 
-If all la-l^ are NO or no response, 

code '9* to all 2a-4f and go to 

topic 2 

-if no response, code '9' to all 3a-4f 
and go to topjc 2 

-if NO, code to all 3a-4f andgo 
to topic 2 

-code as marked ^ , ^ ^ 

-code as marked 



byte 5'schoal size 

1 ■ enrolled first year stu<|eAt$ 
^25 - 7 * 

'^i? enrolled first-year studtnts 
* 26-100 ^ 

3 • enrolled first •year students 

101-250 

4 ■ erirolled first year students 

- 251-1000 . 

5 ^ enrolled first year students 
, >1000» 

'byte 6-10 sequential numeric code 

( 00001 -nnnno) unique for each school 

byte 11 data source Cb^e 

1 ■ data obtained from public 

doeiiments only^ * . 

2 ■ data obtained from documents 

plus personal Interview' ^ 

3 ■ data validity checked by 

second InterA/lewer 



C 



yes 



^0',Kno response * '9' 





NO YES 


8 


nQ YES 


8- 


3a(l) 


2 0 


0 4c(7) 


1 0 




3b(2) 


2 0 


0 4d 8) 


0 0 


0 - 


3c(3) 


1 0 


0 4e(9) 


0 1 


0 ;r 


3d 4) 


0 0 


0 4f(10) 


1 0 


p ^\ 


4a(5) 


2 0 


0 






4b(6) 


1 0 


0 • 








YES NO 


8 ' 


YES ' NO 


8 



-code as marked ^ ^ , 
-code as marked 

-no non-response allowed unless both 
are non-response, else code a single 
non-response as NO('O') 



yes » 'r, no ■ 'O*, no response « '9* 

-If ^no response, code •9' to all 2a-2c; 
go *to 3a 

-if NO, code '8'' to 2a-2c; go to 3a . 
-code as marked 

-if nq. re^onse, code '9* to 4a-4c; 
go to 5a 

-If^NO, code *8* to 4a-4c; go to 5a 
-code as marked 

-If '*no stated admissions policy,** o 
cbde '8* to 6d-6c and go^ to topic 4 
-if no response, code '9* to 6a-6c, 
' go -to topic 4 

-if NO, code •&* to 6a- 6c and go to 

topic 4 
-code as marked 



64. 



0-1 



, Weighting - Item Responses 



Notle: yest no* and *8' (directed 



noniresponse) are in n and weight 
la-vie not weignted 



2a NO « 2 plus 1 for each YES option 
abo^^ two In la-le; YES - 0 



la(l) 
1M2) 

ldl4i 
2a(5) 
3a ^d 
NO m 



1 
1 

2 
2 

3b 
3 



2b(6) 
2c(7) 
2d(8 
2e(9) 
2f(10)^ 
treated as one 
YES, YES • 0 



tem 



YES,Np - 1 NO.YES « 0 



lad) 
2a(2) 
2b(3) 
2c(4) 
3<f(5] 
4a 6) 
<b|7) 
4c(8) 
5a (9) 
6a 10) 
6b(ir 
6c(12 



YES NO 

\ 8 

2 
0 
0 
0 
0 
0 



3 
1 
1 
1 



not weighted 
0 1 0 
0' 1 0 
0 



Field 



Raw Line/Bytes- 



Merged Bytes 



Coding and Editing 



Weighting 



Item Res'ponses 



Topic A - Instructional Staff 



IttBt la 
I tens 2a-f?Y 


1 
6 


1/52 
1/53-58 


.52 . 
53-58 






e. 




Item 3a 
* • 


) 


1/59 




Item 4a*4d 


4 ' 


1/60-63 


60-63 


Topie 5 - Written Disclosure 




Items' la-iy 
Items 2a-2j 
Item 3d 


25 
10 
1 


'1/64-88 
1/89-98 
. 1/99 


64-88 
80-98 
99 . , 


Item 4a 
Item 5a 


1 
1 


1/100 
1/101 


100 
101, 


/ 

Items 6a-6g 


f 


1/1021^108 


1Q2-108 



Topic 6 - Student Orientation 



Item la 


1 


* 1/109 . 


109 


Items 2a-2d 


4 


M/110-113 


110-113 
* • 


■Filler 
" Hecord 10 
School 10 


6 
1 

11 


,1/114-119 
1/120 
" 2/1-11 


does not 
exist 

does no( 

^ exist. 

does not 
exist 


Topic 7 - Job Placement 




Item la 


1 


2/12 * 


114 


litems 2a-2'i 
Items 3a ^3 c 
Items 4a-4b 


8 
3 
2 


2/13-20 
2/21-23 
2/24-25 


115-122 
123-125 
126-127 



Tooic 8 - Recordkeeping Practices* 



Items 1a-1 f 
Item 2a /• 

Togic 9 - St 


6 

1 ' 
abilil 


2/26-31 „ 
2/32 

ty of Instruct 


128-133 
134 

nal Staff 


Item la , 
•Item 2a .5 
4 tern 3a 


3 
3 
1 


2/33-35 
2/36-38 , 
2/39 ^ 


135-13*7 
138-140 
141 



Topic 10 - Representation of States 



Items la-lc 



Items 2a-2b 
Items 3a 



2/40-42 



2/43-44 
2/45 



142-144 



145-146 
147 



yes ■ ^1', no '0*, no response ■ '9' 

-if "no formal review/ code '8* to 
-if 2c is no response, code '9* to 3a-4tf, 
A go to-4opic 5 > 
-code 2f as J ft' (omit from weights) 
-if 2c is NQ. code 'S' to 3a-4d. go to 
topic 5 ^ 

-if no response, code '9' to 4a-4d, go 

to topic 5 

-If NO. code 'B* to 4a-.4d, go to topic 5 
'-code as marked • 
f 

yes "^'r. no » '0', no response ■ '9' 

-code as martoed - ' 

-code 'do not exist' as "B* i*^2a-2J 

-if no response, ^-code *9' to 4a ana go - 

to 5a , . 

-if* NO, code '8* to 4a and go to 5a 
•:Code as. marked ' 
-if no response, code '9' to alt 6a-6g, 

go to topic 6 

-if NO, code '8'. to 6a-6g, go to topic 6 
-code as marked 

yes ■ '1', no ■ '0', no' response * '3' 

^if no respond, code '9' to 2a-2tJ, go 
to topic 7 

-if NO, .code '8' to 2a-2d, go to topic 7 
-code irs marked 



lad) 



0 



2a ,2b, 2d, 2g - treat as. one item 

- lesrthan 3 NO's • 0, three NO's 
« 1, four NO'S • 2 
2c(4) 2 0 tJ^ 
2f(7)«jomit from weighting 
3a(8) 3 0 0 4c(ll) 1 0 0 
4a{9) 1 0 0 4d(l2) 1 0 0 
4b(ld) .1 0 0 



NO YES 8 
la-ly .5 0 0 

2a-2b(l-2) f 0 0 
2c-2J(3-10) .5 0 0 
3a(ll) * net weighted ' 
4a(12) . 2 0, 0 
5a(13) not weighted 

6a-6g( 14-20) 1,0 0 



NO 

lap) 3 
2ai2d(2-5) 1 



YES 
0 
0 



v/bla 



leave blank 
code as '1' , " * 

code as In record '1' above 

yes "i'l', np * '0', r\D response ■ '9* 

-if^NO, code '^' to 2a-2h, go to 3a 
-i^n(f response, code *9' to 2a-2h, 
go to 3a * ^ 

-code as marked; code 2h as 
-If *no students', code '8' . 
-code as marked , W 



la(4 

2a (2. 
2b{3) 
2c(4) 
2d(5) 



NO YES 8 NO ve^ « 

not weighted 2e(6) 0 ;i 0 

0 1 .0, 2f 7) 0 1 0 

1 ' 0 0 2g(8) 1 0.0 

\ 0 P-2h(9) not weighted 
1 0 h 3a(10) 1 0 0 



3b(ll) 2 0 0 
3C(12) 10 0 
4a and 4b treated as ope item o 
NO. NO « 2; YES.NO * 1; YES.YES^ * 0; 
IO.Y£S * 0^ , ' • 



J 



yes * *1 ', no ■ '0' , no response » *9' 

-code as narked; code If as '91_^ 
-code as marked • 



yes ■ '1', no " '0', no response ",'9' 

-code in mual number 000 < 989 
-code ^999^1 f nolhesponse • \ 

-code actual percentage 000 * P « 100" 
-code '.999' if no response 
-code as marked 



NO 

lad) '1 
lb(2) 1 
lc(3) 1 
ld{4) 1 



YES 
0 
0 

0/ 
,0 



8 NO YES 8 \ 

0' le(5) 1 0 0 
0 lf(6) not weighted 
0 lib) 3^0' 0 
0 



laX not weighted 
X- 05 - 0 2-5% « 2 

1-2S -1 ^' 5X - 3 
3a - NO = 0 YES « 2 3^0 



yes 



•r, no - '0*, no response - '9' 



-if no response to allja-lc, code '9' 
to 2a-2b, go to 3a 

-if NO to all la^lc^ code '8* to '2a- 
2b, go to 3a 

-if any YES, g0no.2a ^ 
-else code '9' 'to 2a-2b and go to 3a 
-code as marked 
-code as m^l^ed 



lad) 
lb(2) 



NO 

d 

0 



lc(3)/ 0 



3a(6) 



YES 8 

/l 0 
0 
0 
0 

9 



0-2 



65 



Field Name 



ten^th 



Raw»).lfte/Bytes 



Topic 11 ' Financial Stability 



Merged Bytes 



> 


Items la-Id 
Item 2a 


4 

1 ' 


^2/46-49 
- 2/50 




Item 3a 
Item 4a 
Item 5a 


1 
1 

r 


2/51 
2/52 
2/53 




Items 6a-6b 


2 


2/54-55^ 




Tooic 12 - 


nstructlc^al f^rogram; 


- .' ■ 


Items Ja-lb 


2 


2/56-57 ' 


* 


Items '2a-2b 
Item 3a 
Item 4a 
Itenrta 
Item 6a 
Item 7a*t 
Ite?i 8a • 


2 
1 
1 
1 
1 

.1- 


< 

2/58-59 

2/60 
• 2/61 
•2/62 

2/63 

2/6n 

2/65 




U8-151 

/ 

i5i 

154 
155 



156-157 



158-159 



160-161 
162 
.1)63 
164 
165 
166 
167 i 



Topic ' 13 - Instructional Facil)t.Tes 



Itenv la 



Items 2a- 
Item 3a 
Item 4a 



2b 



1 



2/66 



2/67r68 

2/69 

2/70 



168 

169- 

171 

172 



170 



V 



Coding and Editing 



y 



yes « 'r, no » '0', no response ■ •9' 

-code as marked * 
•if YES, code 'S' to 3a-6b^ go to topic 
12 

-code as marked 

-code as marked • • . * 

-if tio response, code '9* to'6a-6b, go 
ta topic 12 
-if NO, code '8' to 6a-6b, gb to topic 12 
-code a;5 marked 



t-o 

V 



yes ■ '1', no * '0', no response 

not required * •8* 
-if»no response to both/ code '9' 

2a-2b, go. to 3a 
-If no to both, code 'S' to 2a-2b, go to 

3a * ' / 

-if NO and no response, code -'9' to 2a- 
2b, go to 3a ' , i 

-code as marke^ ^ -^ 
-code as marked • , ^ ■ 

-code as marked 
-iode ^s marked 
-code as parked 
•code as marked 

Vcode as marked ^ * 

yes « '1', no » '0', no response * '9' 

-if no response, code •9* to 2a-2b, 
go to ^a 

-If NO,xOde '8* to 2a-2b, go to 3a 
-code as. marked 
-code as marked 
-code as marked 




Weighting - Item Responses 



treat la & lb as one item, Ic 
one item: NO, NO » H YES, NO 
YES, YES « 0; NO, YES - 0 



& Id as 
. 1; «» 



/ - 





NO YES 8 


2a(l) 


not weighted 


3a(2) 


2 0 0 


4a(3) 


0 2 0 


5a(4) 


0 3 0 


6a(5) 


2 0 0 


6b(6) 


2 0 0 



treat la 4 lb as, one item: NO, NO 
YES,NO -« 1; YES, YES » 0; NO, YES 

treat 2a & 2^as«oif-item: NO, NO 
YES, NO « 1; YES, YE? «'0; NO, YES 



3; - 
0 
2; 
0 



3a(l) 
4a(2) 
5a(3) 
6a(4) 
7a(5) 
8a(6) 



NO 
2 
2 

-2 
2 
2 
2 



YES 
0 
0 
0 
0 
0 
0 



NO YES 8 
la(l) 2 0 0 

treat 2a & 2b as one item: NO, NO « 2; 
YES, NO = 1; YES, YES » 0; "NO, YES ^ 0 
3a(2) 2 0 0 
4a(3) 2 0 0 



.D-3 



ERIC 



66 



PUl OPTIMIZING "compiler 



^, /•, IVfEIfiHT, - WEIGHT THE ITEMS ON THE JRF'S TO GET TOPIC SCORES 



^ PAGE • 2' ^ 



STMT LEV NT 




IWEIGHT'l THI<; PROGRAM IS USFD FOR BOTH DEGREE AND NON-DEGREE ' 



' -n 



/•, iWFI-fiHT - WFIG^«r'THF ITFMS ON THF- IRF'S TO GET. TOPIC SCOBfS" """•7~""8o7' 

■ ^' ~" ' \io';~ 

120. 

140. 
150. 

-19D._ . 
200. 
210. 

220.. 

230. 
240. 



«« 
«« 



.^.J.N5T1IUII0MS to WEIGHT EACH IfEM' ON THE IRF, FOR EACH 

TOPIC A TOPIC SCORE IS DEFINED AS THE SUM (ft" THE WEIGHTS** 
DIVIDED BY THF N OF REAL RESPONSES/ A. REAL RESPONSE 
IS^O'iiEiTbAl IS ANSWEREO EITHER YES*' NO* OR A DIRECTED 
NON-RFSPONSE (CODED AS •8t)t NOT A KTSSJNG DAJA OF THE 
VARIETY THAT IS CODED •9t. 
.^.SPUl^ HALF ..SCORES ARE ALSO DERIVED FOR .EACH 'TOPIC AREA 
ANfXl^i OVERALL IRF SCORE IS- DEFINED AS thE SUM OF THE — - 
TOPIC WEIGHTS DIVIDED RY THE' MUMPER OF TOPICS FOR WHICH 

THF^_J/AS_«A MQN-ZERQ (REAL) N. . ^ _ •• 

NOTFI IF IHE^E ARE NO VALID. ITEMS FOR ANY TOPIC'OR FOR" 
V ALL TOPlCSt THE RELATED 45C"0Rt;S(TCfTAL 'AND SPLIT' 
^ HALVES). WILL BE ALL 9»S. . 



AN^ OUTPUT FILF VilTH THE ORIGINAL ITEM DATAt TOPIC AND '1RF»» 
iHETGHTS»N»S.SPL^T-HALF WEIGHTS AND'N^SUOPIC AND IRF. 
•SCORES L^,. QFyE;j.QP5g WHICH WILL RE MERGED WITH COMPpSlfEft** 
ESO DATA TO FORM] AN ANALYSIS FILE TOR PROJEJCT. 52^801' 

fr \ , , • 



to 

3" m 



^« 

«« 

^1^^^^.^^^ Z - V 



1L.AUIfciOejJifiLDi-I_LEE BLOOIlJi^. 



DATEI 12 MAY 19>6 #• 
REVISEDI 17 SEPT 1976 



— 1 -lJL--IWF.iGHIL.,E8QC_QPT.LQNS,lHAIN);? 

? I ,0 ' OCL MfRGDAT. FILF INPUT HECOROi * 
s , JGKIliAI-.ElLE-JlUlPUl RECORD J 

1 0 DCL (In1cNTiDUT_CNT) PIC »99999» INIT JO) I 



260. 
270. 

290. 
300. 

320. 
330. 

—3*0 



3 



4 ' 1 



DCL^ POINTER STATIC? 
— Pq 1 ^ MLR£ JiEC: tiA5E0..XP la 



MID 
TOPICl (16) 
■T0PIC^^2J 



p!er|c 



5 TOPIC3(}'21 
5,T0PIC4C12) 
S TOP ICS 



S T0P1C6C5) 



CHAR(U)f 
PIC t9tt 

Pl£. ^9M. ^ 

PIC •9t» ^ 
PIC K9 9 f 

. PlCll9*j 

PIC •9tt^ 



BYTES 
/• BYTES 
/• BYtES 
/♦ BYTES 
/♦ BYTES 

BYTES 
/• BYTts 



12-27 REFUND ' •/ 
28ri9-AfeyERTv_tZ. 



40-51 ADMISS10(5»/ 
52-(b3 STAFF '•/ 
6<»-l OB DISCLOSE/.. 
109-113 ORIEKT.V 

2 



350. 
360. 
- 37Q._^ 
380. 
390. 

410. 
.420. 

—43(1. 

440. 
° 450. / 

_Mi)._L 

470. 
. 460. 

^00. 
510. 

-J520. 



68 



PUl OPTIMIZING COMPILEP 



IWFIGHT - WEIpHT THE JTEMS ON THE IRF«S 10 GET 10P1C SCORES 



STMT I NT. 



h 

b 
5 

5 

b 
5 



M7r . 



TOPICTO 
TUPICP 
I0HIC9i7)„. 
TOPTClO (6) 

lopjcn (10) 

TQRlCl2(lfi). 
T0PIC13<S) 
STATRATF* 
NQUS1UDENT5 
AGCPFH . 
AGE ' . . 



PIC 
PIC 
PIC 

PIf 

PIC 
PIC 
PIC 



OCL 



•9»f 
»9» t 
191, 

• 9»f 

191, 

CHAI%<d) f 
PIC • 9999 • , 
CHAR C U • 
CHAP<1) I 



1 MERG^RFC'OVLAY BASED (P) t . 
S MIO GKARCJl) t 

a.IQFICl_SIR_:_ _ . .CHAR(1)&) 1 

" ^" ' ' , r'H AR<<1?) f 

\ ' CHAP (42) 
CHARd?) f 



t . 



. 5 10PIC?_<;Tt< 
S 70PIC1 STP' 

b -T0PIC5_STR 
5 T0PIC6 STR 

5 TOPTCP^STR^ 
. b TnPJC9_<;TR 
i..IQEIClQ;^'^Tf{ 

S topic;! I SIR 

5 T0PIC12 StR 
. 5,.IQpJC13rsrR 

5 STATRATF 



THAR (45) f 
'CHAR(5) f 
CHAR ( H) f 
rHAR(7)f, 
CHARi?) f. 
CHAI?(6) f 
'CHAR( 10) f 
CHAR(IO) f 
.?CHAR(^) f 
CHARC8) r 



.t)a..l.IOTAiS.§TAlIQi.».,- , . 
5 TARRAY(4) t- 

10 TWGT.SUM 

. Ifl-Jtbi.. ^ 

10 T" SCORE P 
TAKPAY(l) = SPUIT^HAir^A 



/♦ BYTES 114-127 JOBS - */ 
/« BYTES 128-134 RECORDSV 
/* BYTES 135-141 STABtL.*/ 
/« BYTES 142-147 STATUS •/ 
/« BYTES 148-157 FINANC •/ 
/* BYTES 158-167 PROGRAM*/ 
/* BYTES' 16e-172 FACILITV 
/« BYTES 173-180 RATING ♦/ 
/• BYTES 181-184 STUDS V 
/» BYTE lp5 ACCREDITA. ' •/ 
/« BYTE 186 AGE OP SCHt •/ 



FIXED(5f2)% 
FIXED(3fO)f. 
FlXEO,(^tO) \ 

TARRAYOi = 
' TAPRAY(^) » 



TOPIC 
IRF ' 



DCL 



1 WGHT 



REC* STATlCf 



§ TOPIC] (16) 
5 T0PIC2(1?) 
_iLJLQElCitl2i 



5 T0PIC4C12) 

5 TOPIC«5(45) ; * 

JLlSmmBl L 



fE^- 69_, 



5 T0P1C7(14) 
5 TOPICftl-?) 
5 T0PT C9(7 ) 
5 t6pJCJ0J6) 



/♦ LRfCts 
CHARdDf 
PIC .•9»f 
191, 
191, 

•9»f 

t9t, 
f9t , 

•9^'» 



PIC 
PIC 
PIC 
PIC 
PIC. 
PIC 
PIC 
PIC 
PIC 



81-6 ♦/ 

/« BYTES 1-1 1 :. I'V 

BYTES 12-27 REFUND 

/« BYTES 28-39 ,AD^^^RT. 



5^0 • 
550. 

570. 
580« 
590 • 
60b« 
61 Ot 
62Q« 
63Q« 
640« 

650t . . 
660 • > 
670. 

. eeOf 

690 • . , 

700^ 

7IQ1.. 

720. 

730.^ 

750. 
760. 

. JjatL^^ 
760. 

\^ 790. ; . 
1.. eoor^i-. 

810. ; 
fr20. 

830 1 C. 

840. 
850. ' 
^ 860t J„ 
87&. 
880. ^ 

e9o,t_;^.^ 

900. 
910. 

930. 
940. 



/• BYTES 
/•'^BYTES 
/•BYTES 
BYTES 
BYTES 
BYTES 



/• 

./• 
/• 
y» 

/• 



40-51 . AnMISSIQNV.._. 955c_-, 
52-63 STAPF •/ 96jP. 
64-108 OlSCLOS.*/ 97«.." ' 

l09-n3.QpIENT..V 98Qa_:..1_ 

JOBS •/ 990. " 
RECORDSV 1000. 
STABIU,*/ 1010. 
STATUS 1 0.20 ..7 

• . . ■■} 



114-127 
l?8-i34 
BYTES' 135-141 
BYTE& 142-147 



PL/I OPTIMIZING COMPILrR 



/f JWEIGHT - WEIGHT THE 



ITEMS' ON THE IRF'S TO GET TOPIC SCO 



RTMT LEV NT 



"*^*T"^'5* TOP fell 



5 TOPICIKIO) 
S TOPICl?(10) 

.5 TPPICI3(5)... . . 
? statratf. 

S NO_STl»OrNTS 

5 AGE 
5 T0PIC_TnTALS(13) t 
lQ TTARRAY(3)f 
15 wor <;UM 

15 NJ " 

15 SCORE 

5 IRF^WHT^UM . 
5 IRF^N . * 
.fe».lRF_SCQRE . ^ 
5 IRKA^WGT.Sl.'M 
S IRFA^W 

5 iRF;A25cnRE 

"iRFB WGT.SUM 
'5'1RK8^M , 
^ TRFB.SCORE 



PIC •9«t 
PIC 'Qft 
PIC •9»f 

CHAR (6) t 
PIC»9999» t 
CHAR U ) • 
CHARU) t 



/♦ BYTES 148-157 FINANC •/ 
/• BYTES I58*l^67 PROGRAM^/ 
/•'bytes 168-172' FACIUIT*/ 
/* BYTES 173-180 RATING •/ 
/• WTES 181-184 STUDS 
/♦ BYTE 185 ACCREOITA, 
/» BYTE JL86.AGE OF SCH. 
/♦ ONE PER TOPIC AREA 



»/ 
#/ 

•/ 
•/ 



/* SPLlTAf SPLITBtTOPIC IN THAT ORDER •/^ 
PIC ^.9^9 V99.^ t 



PTC 
PIC 
PIC 
PIC 
PIC 
PIC 
PTC 
PTC 
PTC 
PIC 
PIC 



•999» t 

•999999y • t 
•9999V99»t 

• 999t t . 

t 999999V »^ 
•9999V99' t 
•999« t 
1 999999V 1 1 

• 9999V99« t 
•999»f . 
•999Q99V' I 



m 
t 

<jj 



OCL 



WGTSC IB.'it 



ERIC"- 



IT 



" OtO 
OtO 

. ... 0,0 
'•. ?ti 

OiO 

OtO_, 

lt3 
• OtO 

^3,(i 

0^0 
OtO 

OtU 
OtO 

_._3il 
OtO 
OtO 

(b.QjJ 

Otl 
OtO 

J*l 

OtO 
0.0 

QjO. 



OtO 



0. 
0 

0 

Q 
? 
a 

0 

b 

0 

S 

0 

0 

^1 

0 



3il 
0 



ItO 
OtO 

0. 0 
OifO 

iti 

O'tO 

1. tl 

OtO 



gio 



Of OiOtO 



UtO 

0. 0 
..5 
OtO 

dtO 

OfO 
OtO 
OtO 
Oil 

1. ft. 

OtO 
3f0 
OtO 

ofo 

fifO 

<r»o 



STATIC 
OtOi 
OtOi 
OtO 
OtO 
,OtO 
OtO 

Itl 

OtO 
OtO, 

Itl 

OtO 
OtO 
5t.! 
OtO 
0*0 
QfO 
OtO 
OtO 
2.1 
OtO 
i 0 f 0' 
OfO 
OtO 
O'tO 
OfO 

•o«o 



t.5tOt?t 



1030. 
3040, 
.1050.. 
1060. 
1070. 
1080t 
1096, 
1100. 

lUO. 
1120. 
1130. 

. IHO,. 
1150, 
1160. 
-l.I70i 

1)80, 
1190. 

l?.09j 

1210. 
1220. 

- ..123fitJ 
1240. i 
1250, 

• 1270,: 
'1280,1 
.1?.9Q..: 
1300, 
1310, 

J3_2Q,J 

1330, 
n340.- 
..l35Q,i; 
1360,; 
• 1370, 
_ 1380, 
1390,; 
1400, 
1410. 
1420, 
1430:. 
...1440., 
, -1450, 
1460..- 
:..Jl470i 
**»1480. 

1490. 
__ 1.50ff^ 
1510. 



■-. -I 

,PPT1MI2ING-C0MPIUR 



/♦ IWEI6HT • WEIGHT THE ITEMS m THE fRF»S TO GET TOPIC SCCiRifeS:=: 



^STHT LEV NT 



. OtOtOfOf OtOfOtOfOtOtOtOf 
OtOf 0f2jl t3t0f OfOfOfOtOt 

IfltLfQjJlfQiiifQfOf OfOfOf 

OfOfPfOfOfOfOfOfOfOfOfOf 

Ot?<0t0f Ptat'^f otOfOf Otat 

^^..iiQjEiaiOjQfOf OtQf OfO»'Of 

OfOtOtOtOfOfOtOfOtOfOfOf 
- 2f?t2»2t?t2i0t0t0f q,j;^PtOt 

tttOtOtOtOtOtOfOf Of Of Of Ot 

OfOfOfOfif^fOfG^OtOtOfOtOt 
^,2f0tOt2f2f0fOtOt0fOt0t0t 

_0Lia»JijQfi)^Ofi?f OfOf Of OfOf 

Of0fOtO.fn«o«o»OfOfOt0tO)i 



This lABlE IS ORGANI7F0 AS FOLLOWS: 

ftr<;t nI^'FNsIo^J(^3) topic areas 

SECOMD-DIMENSIONJa). = ANSWERS TKAT ARE . 
COUi^TED as real I,E; r:jO=ltYES«2f '8t«3 
SUBSCRIPTED BY J WITHIN CODE. 
THIRD DlME^ISMtiUEJ ITEMS WITHIN TOPIC , 



m 



•/ 
V 

/««ft««««»««(i»«««»«»««« ««•*»«««»«« ««««««««»««««««»«««»«*««^ 

•««««««««««««»«««««««•*«•««*«/ 



1520* . ? 
1530. 
. 1540* 
1550. 
1560..' 

-1570.. 
1580, 
1590.' 

161.0. 
1620. 

.. .163.0* . 
1640,, 
1650. 

1670. 
)680. 

.16.90^. 



10- 1 0 

.11 I__IL 



ON ENDFI|^£<MFRGDAT) GO TO CLOSF.FILESI 



1? ' 1 



PUT SKIP (2) 



iR&DAILi_fJLE.tweHlDAT)..l... .. 
EDIT CALL FILES OPENED') 



(X(10) tA) I 



1700* ' 
1710. 

1720< 

1730. 
17<^0.. 
^ 1750*:_ 

l76o;^ 

1770. (• 

12M»_1^ 



JJ 1 0 PFAO MFPGOATL 



(P) » 



PEAO FILE (MEBGDAT) SET 
14 1 J) JN.CNT », II^^CNT • 11 

AS^ 1 0 hSl \ g, V» TO _.^_J?F.SET .TQTAtS. ARRAY 



16l^.- I 
17 1 
J-ft < I. 



♦V 



1790.- 
1800. 

I820i 
1836.; 

.lei&LOl^ 



19 



TWGT.SUM ( I )> = 0» 
''T Ml) = 01 
T,,SCQflEJ If =» 01 _ 



1 1 ENDI. 

/• RESET TOTAL FIELDS IN OUTPUT 
IRF_W&T_StiM .s-lll. : . . . 



21 
22 

-23. 



RECORD 



. 18S0.- 

ia60# 

lespi. 

1690^ 

1900^ 



IHF^SCnpE s 01 



ill 



24 V 0 IRFA^N % Of ^ 

1 0 ' IHFA^SCORE » 0| 
T O lR FR_WGT_SaM n 0|. 



27 
^8 



1 0 IHFB.N = Ut 

,1 '0 ,IHFB SCORf a 01 , 




30 .1 1 



DO ^ *. I TO 31 



... 



)970. 
1980. . 

.19M^ 

20fl0^ 



JPin OPTIMIZING COMPILER 



STMt LFV h'T 



IWEIGHT - WEIGHT'TMF ITEMS ON- THE IRF«S TO GET TOPIC "SCC 



31 I 

32 I 



34 
3? 
^ 36: 



? 

a 

2 

1 



IfGT^SOMdfJ) »'0t 
•NflVJ,) s 01 
5CQP£(ItJ) . * Ql . , 

F.NDT 

WbHTJvTC = MFeOJ^ECf BY NAME? 

/♦NKiOTEl IN EACH ITFM; UYESt 0»NOt8=OTPECTFO NON-RESPONSL 
/*, AMD 9sMlSSING DXtA(NOT INCLUDED IN .N) 



1^ 37.. 


„ L 


0 


3ft 


I 


0^ 


39 


. 1 


I 


40: 


1. 




41 


1 


0 



m 
I • 



L JL . 

43 ^ r 
44^ 1 I 

-.45 1 l_ 

4fi 1 1 



• 47 ^ L^li: 



4fl \.0 

49 1 1 

51 ' 1 1 

52 1 1 



A 



54 
'55 

-_56 . 
R7 

_59^ 
60 
61 
62. 
63v 
6.4. 



1 1 
1 1 



1 

) 

± 
1 
1 

1, 
1 
1 



1 

? 

2 , 
2 

2 



..^S. 1 _2.. 

66 ■ I 2 
.67 1 



/» PP(^CESS inPTCl' • RFF'UND 'POLICIES 

COU^jT YES»S.IN 1A«- IE •/ 
. . J r ?L;._/*. WHERE^J IS 'THE number OF yFS»S 
^ DO I « 1 TO SI ^ /• WHERE I c NO. OF ITEMS IN lA-lF 
IF MERG^REC.TOPICl (I) = 1 THEN J s J ♦ 11 - 

Eh^li . >. . . . 

K = II /* K IS USFD THROUGHOUT AS THF SPLIT HAIF INDICATOR 
/» PROCESS ITEM 2A. 

-.^.IF,.b^wO£C*IfiPICl(&l..^.L I HER0J?EC.T0PTC1(6) =e tHFN noT 
T_N(3) .3 J.N(3i ♦ 1 1 
T_N(K) c't_N(K)' ♦ ll 

K.f-l! ; . 

IP K > ? ThFN H s 11 

WEIGHT = 0 FOR YFS OR OIRFCTfcD NON-PESPONSE (H) 

EL'DI, , ^ . ^ 

J-LSF If"mFrV1rEC.t6pIC1 (6) := 0 THFN DOT 
Tjv(3) » T.N(3) ♦ ^1 ; 
TW0T_SUM(3) = TWGT_SUM<3> 
T_N{K) = TJ>I<K) II 
TWrTT_SUM<K) s TWGT^SUM(K) 
- b-_ = ^.^t. If . * ^ 

IF K > ? THEN Kail • ^' ^ 

^NOI 

DO. I =.1M0 IQI . . PROCESS ITEMS 3A-4F 
IF Mf.RG^RFC.TOPICl (1^6) -^s ^ THEN OOl 

IF MFRG.RFC.TOPICl <J*f») = H THEN J 

. ^ - - -\.£LSE,J.s MERGiREC.T0Mci(I*6) 

T_M(3) ^_N(3) II 
T^N(K) = T N(K) ♦ II ^ 

JirfGT;.SUM(3) .3? TWGT^SUMO) ♦ WGTSdtJtDI 

TWGT_SUM(K) = «t6T_5UM(k). ♦ WGTS(1«J^I)| 
K = K ♦ 11 ' ^ 

IE. K'.^ S^THEN Jf II ' . 

ENDI 



2 ♦ Jl 



♦ 2 



sll 



s 31 



• 68 



1' 2 



/• FINISH T0PTC1 
DO I i: 1 TO 31 

ir_.i_bu.iL_>„.9 tHEM.im'f 



T.SCORE(ni'<<TWGT.SyM(I) • l000)/T>(I)FV',5r 



2010, 
2020* 
2030. 
2040. 
2050. 
206Qi. 
2070. 
2080. ] 

?i6o. 

?1L0. 
212P. 
2130. 
2140. 
2150. 
2160, 
2170* 

ZIQQ, 

^ 2J90. 
2200.1 
.2210. 
2220. 
2230. 

2250. 
2260. 
... .2270j 
. 2280. 
2290, 

2300 1 

2310. j 
2320. 
2330« 
2340. 
2350. 
.2360. 
2370. 

27ero. 

.239SU. 
2400, 
2410. 
.2420.. 
' 2430. 
2440. 

24S0JI 

2460. 
2470.' 

; 2490.: 



tl 



PL/I PPTIMI71N6 COMPILER 



/• IWEIGHT - WEIGHT THE ITEMS ON THE IRF'S TO GET tOPJC SCOR 

_______ . . * 



STMT LEV MT 



H \ 2 
72 1 1 

13 -,1— J. 

74 \ 

75 1 
76.__ 1- 

77. 1 
78* 1 
: 79 1- 



.an 1 —IL- 

81 1 0 

82 1 1 

_B3 1 2.: 



ENDI . 
. ELSE T SCORE (iKi 9999991 
W6T^u5.aiIl,_S-4WGT_SUM{IIt 

M(1»I) "^-y-T.Nd) t 

SCORtd.n •= T^SCOREdM 
.Tle!bI„SUyJIJ 5 -III 

T_N(I) . = OJ 

T_scoRE(i) - a% 

.-ENDl - — -.- - . - • 



\ 



m 

I • 

■icri"- 




84 , 1 2 

85 .1 2 
_a6 1—2.- 

87 1 2 
8B^ 1 2 

.aa. 1 2_ 



90 1 2 

91 1 2 

9? .. J l- 



93 "I 0 



PROCFSfi TOPTC? - AlJV£RTI«;iNG 

JSL_ = ..llZ- SPLLI- ilALF J-NDlCATQfi . . .._.*- 

DO I "9 1 TO lOj /••PROCESS ITEMS 1A-2F 

IF MERG RFC,T0PIC2(I) 9 THEN 001 

: TF''MrRG_RFC.T0PIC2(I) « 8 THEN, J = 31 

FLSE J = MFRG_REC.T0PIC2(I>- ♦ It 
T Ni(3) = T_N(3l * 11 

JJ±m.=-.Ut\lK).*A\ . - . -. 

TWGT*SUM(3) a TWGT_SUM(3) ♦ •WGTS(2« J.D t 
TW6t3uM<K) a TWGT_S.UM(K) ♦ WGTS(?.J«1)» 

'■ ^ IF K >'2 THENrK s 1» 

end; . , ' ' . 

-EhiDJ ... . - ... . .. 

/• PROCFSS ITEMS 3A AND 3B,AS ONE RESPONSE • ^ 

IF MERG (^£C.T0PIC2(11) ='«>«. MERG_RtC,T0PIC2 ( 12) « 9 



♦/ 



94 1 0 
"95 1 0 
.Sfc 1 IL 



-.91- 
98 



lr_.,Q. 
1 1 
1 1 
L. 



■ THFN Gft Tn FIMISH„T0PIC2I . ' . . 

T_M(3) = T_N»3) t; 15 . . t * . 

T NIK) T_N(K) ♦It . • ' ■ - • 

HR«;TR(T0P Tr?_STR.11»2> I SUBSTR{.T0PIC2_';TRtiIx?.L-= 
THEN GO TO FIN.ISHt.T0PIC2t ., ' 
/» YES»-YE^ AND NO. YES * WGT OF ZERO 
AfjjSUBSlBiXQPIC23lEaIlj21_= 'tOOHEN OOf . 
TW6T SUMO) = TWRT_SnM(3) ♦ i;.*' . 
TWGT SUM(X) = TWGT_SUM(K) ♦ It 
GO Th FINISH TQPIj;:2t ._ _ ^ *__ 



2500. 
2510. 

. . . :. . .2520.:_ 
" 2530. 
9540. 

.. • 2550*.- 

2560. 
• 2570. 

. .258(1. ... 

. 2590.. 

•/ ?6po. ; 

2610. J 
2620. i 
2630. i 

2650. j 
2660. 

26TJ)t_. 

2680; 
, 2690. 

_210Q*_ 

2710. 
2720. 

_1 2131).... 

•/ 2740. 
2750. 

27.6fl^ 

2770.' 
- v 2780. 
— '1?1>LJ2790. j 
f2800. 
♦/ >^2ai0." 

SeSflL*. 

2830, 
2840. 



101 
102 

003- 



1 . 1 END4 - . 
I 6 IF SUBSTR(TOPIC25^STR.n.2) ,« 'OO' THEN 
1 \ Twr,T_«;iiMf<r X TWfiT_SUM iil_.i_3 1,^ 



not 



104 

105 
106. 



1 1 
1 1 

r \ 



T 



TWGT SUM(K) = TWGT_SliM(K) 
- GO TO FINlSH_TOPlr?t 

FNot 



107 



FINISH T0PIC2: 
no T s 1 TP 



31 



2e50.,J 

2860. 
2870, 

. 2890. 
2900. 

.2920. 
2930. 
M M. 



108 I 

109 • I, 



1 
2 



IF T 
ENDt 



N(I) > 0 THEN DOt 
T_SCORE(I) a ( (TW6J_SUM(I) 



iqOO)/>TJJ(n ); 



♦ .51 



UK 1 1 



/ ELSE T.SCOREdJ » ,^9'9999t 



73- 



29S0..S 
2960.1 

2980. 



PL/T'OPTIMinNG COMPILF.R 



/• ""iWEIGHT • WEIGHT THE ITEMS >N THE IRF'S TO GET 'TOPIC SCORE 



STMT. LEV NT 



112. 
113 



115 
lift 

_LLZ- 



llfl 



HQ 


1 


0 




1 


0 


121 






l^^ 


1 


2 


^ L23. 


-X 




124 


1 


2 


1?S 


\ 


2 






2 _ 


1?7 


1 


2 . 


1?8 


1 - 


2 


129 




.a: - 


130 


1 


2 


. ni 


n 


1 



1 I WGT3UM(2a) » TWGT.^SUM ( I ) I 

t 1- • N(2f I) 3 T^N(I)I ^ 

1 :\ SCQBEL< 2x1 1 5. USCORt M ) I 

.1 1 TW0T_5UM(I) = 01 . , 

11' T N(T) ^ = 0$ 

J[:^CQRm) ~ , . . 

1 I' ENOI 

'/» PPnrgc;<; TOPTCJ^<»- ADMIgSIQNS POLICIES - 

K = II , 7^/* SPIIT HALF INOJCATOR */ 
DO 1 = 1 f2f3f4,5f6f7ffl»10,lU 121 /* PROCESS ITEMS 1A-6C FXCE;pT*/ 



/<* OONa PROCESS 5A 



m 

K ' 



IF MERG REC,T0PIC3< II -^^ 9 THEN DM 

IF^MFRG REC.T0P1C3(I) = 8 THEN J 31 

^: ELSE. J- s MERG^REC',T0PIC3(n ♦ II 

T^N(l) = T_N<3) 1 1 

T N(K) = T N(K) ^4 n ' ' 

^£&OUM.131-.= .TyfiT_5UM(3) ♦ WGTS(3fJfI)? 

TWGT.5UM(K) s TWGT.SUM(K) ♦ WGTSOfJfDI, 
K = K ♦ U 

IE. 1<:„>.2.THEN K.r II . • 

'ENOI 



13.2 

JL33,. 



FINISH T0PIC3 
00 I « 1 T 



n4 

135 



2 
2 



« 1 .T(y II. 

IF T,rt(Y) > 0 THEN DDI ; . 

T^SCOREd) = HTWGT^SUMJI) * 1 000 ) /T_N ( 11 ) ♦ .51 

^^^^^ " / - ^ 



137 
138 



140 
•141 
14? 



1 
1 

1 
1 



-J— 



WGT.SUM(3,U = TWST_SUMU)I 
N.('3,I) ^ = T_N<I)I 
SCQREli* LI S-J^^OPE ( 1 ) » 



TW&T_SUM(I) 
T N(l) 

-.lISQQSElXL- 



01 
= o; 



U3 1 1- 



ENOI 




PRpr.C«;<; TnPTT^ - fMSTRUCTIONAL STAFF - - 

K = i; /» SPLIT HALF INDICATOR 

/» C6UNT NO'S IN 2A»2B,20»2E * 

I = n» /?_WHEflF. L IS NUMBER OF NO'S, 



00 1 a l»2»'4.5l • . . . . 

' IF MERG^REC.TOPlC<»(,ir'= 0 THEN L a.L * H 




U 9 



/» PROCESS lA- 40 EXCEPT 2Aj2B,?0»AN0 2F 
/» AL«0 SKIP ?F WHICH IS NOT WEIGHTED 
PC). T = 1 .4.fl ^9riajl-LiI2-t— ■ . . 



ISO- I 1 



IF MERG_REC*TOPIC<»(I) •'S 9 THEN 001 



2990. 
. 3000. 
30.10. 

* 3020. 
3030. 

3050. 

3060. 
. 307a.. 

3080. 

3090.' 
. 310 Q .., 

3110. 

3120. 
..J3130.- 

3U0. 

* 3150..^ 
_316Q.Z 

3170. 
3160. 

3200. 
3210. 

__322i)*. 

3230. 

3240. 
_.:J25Qiu_ 

3260. 

3270. 

3290. 
3300. 
_.331Q.. 
3320 • 
3330. 

3350. 
3360. 

.._337.Q.- 
3380. 
3390. 

3410. 
3420. 

3440 ; 

3450. 
-346Q,_ 
3<»70. 



PL/I OPTIMIZING COMPILEP 



- *r 



/♦ ^WEIGHT - WEIGHT THE ITEMS ON THE IRFtS tO GET TOPIC SCORESl 



STMT LEV NT 



I 0 

. a. 

16/* 1*0 
16S 10 
44^6 1 - Jll 



00 



151 \ 2 ^ IF' MFRG^RECtTOPIC^d) « 8-THEN J s 31 

152^ 1 2 FLSE J s MERG^REC#T0PIC4( I) ♦ II 

i:S3 U^a X^Mi31.-a.T Ne3) ♦ U 

154 .1 2. T_M<K> s T^lsifK) ♦ ir' ' 

155 f 2 \ TWGT;^SUM<37^^W6T_SUH<3) ♦ WGTS.(4fJtni 
-156-^ 1- 2-^i_l.- IlrfGT_-SUMlK)-<s TW6T.SUM(K)^ WGTS(4fJtI) l 

157 1 2 ^ . K = K ♦ II / . i < 

158 1 2 IF K > ? THEN K = II / 

isa.-^ 1 a^.i. £mi . _ ■ r 

160 1 ^1 tNOI • / 

^ /* WFIGHT ITFMS 2Af2Bf?p,ANO 2F AS ONF'lTEM 

.161 — 4 L-JLt SUfiSTei.T0PIC4_SJR»2»2) = •99* & SUB5TR fT0PlC,4_STf^t5 J99t 

THEN GO TO FINISH' T0PIC4I - ' 
T^N(3)^» T.N(3) ♦ n , " 

_L^MXKi-a_tJilUU~-*-Xl> . 

IF^L < 3 THFN 60 TO F IMISH^TOPJC^ I • | /« WFIG4HT IS* 7ER0 
T»<GT_SUM(3) = TWGT.SUM^) ♦ (L^- 2)1 ' ' i 

. tw6X_SUM^V_=:.JW6T^SUM(K) ♦ (L - 2) I ' ; . \ / J ..^^j, 

«. • ' *^ ^ f ■ " " ^ > 

167 1 0 Fir ISH T0PIC4I ' - ! 

^ DO a E^l 'TIL3I -l^: . , ' 

IF T.^JII) > 0 THEM DOI \ . 

T^<;C0PF(I) = ( CT»»GT.SUH(U * 1 000h/T_N ( I ) > ♦ .«il 
: thPl - - _\ " . ^ . 1 

171 11 - FISE T SJCOREU) * 9999991 » , • ' ^ 

172 1 1 ^ r WGT_SUM(4,I) = ' TWGT.SUM (I > I 
.113 L^NiAti)- g T^NIJXt -t - V - 

174 1 T f;rORt(4,I) r SCORE(I)l 

175 1 1 Twr,l_SUM(T) *^ '01 ' ■ 



168 II 

169 'l 2 
4.7^) 1 — ^- 



177 
'17P 



1 1 
1 1 



T SCORE(I) = 01 




END I' 



179 ' 1 0 



/« .PPOCFSS TOPICS -'WRITTEN DISCLOSURE 



K 



II 



SPLIT HALF INDICATOR 



180 1 0 

181 1 1 

.IBZ 1 2 



/» pRnrF,ss iTEMS-iA.:g^, ly 

,DD I * ITO 251 



183 1 ' 2 

184 I 2 

JBS 1 3- 



IF MERGj?EC#T0MC5n) -^^ 9 THEN Do I 

^UfcI13L*J£-j:jSll31-4L,.lL. . _ 

T-^M(K) = T_N(K) ♦ II 1 
If MERGJ^ECiT0Pie5(n « 0 THEN DOI* 



186 . 1 3 

187 . 1-3 

AM 1 ?. 



_IWGT^SiJMU1^5..1WGT^UK(3J ♦ •Sl^. . . 



' "Hw6T_St)M{K) « TWGT_SUM(Kj ♦ .51 
ENDI ' ^ .• ' 

K « K ♦ U 



• ' 189 I 2 

190 1 2 

:er!c '^^ • ! ' 



-EMU. 



FNDI 



-IF 1^ > 2 THEN K 



It 



-ip 



3790, 

JB01U_iJ^ 

3B1'0. 
•/ 3820. 

♦z,„3aafi^_j 

3840» 
3850. 

•3870. 
>a680. 

Laaaiu I 

3900* 
• ,-.3910, 

: _i920j 



/• PRCESS ITEMS 2A - 4A EXCEPT'^^ND SA WHICH >RENtT WEIGHTEO-' 



■.^..LsM.— .-- 



■3930. 
' -3940. - 

..r_J39Sl»Jij 
V 3960, . 



Pt/I OPTIMIZING COMPILER 



/* IWEI6HT. * 'WEIGHT THE ITEMS ON THE IRF«S TO GET TOPIC SCORI 



STMt LEV NT . 



192 M 0 
195 1 n 

^iB(k 1... 2... 

195 1 



^9i> 
-197 
'19fl 

199 

-20 a.- 

^20X 



2 
2 

2 >J 
2 
2 

1-^ . 2 

1 

1 ? 



205 ] 1 
1 

2oa J 
209 1 

210„1 



. l_ 

KO 



.ZU L 



2 

2: 

2 
3 

3_ - 

1 : ^ 
2 

2 



00 I « If2»3f4f5i.6f7f8f9rl0f 12; 

IF MERG REC/TOPICSn ♦ 25) ^ THEN 001 

... 1£ M£eGJ?EC»T0PIC5(I ♦ 25) ^.S THEN J 

ELSE J = MERG^REC. topics ( I ^25) ♦ 
T^N)(3) 5 T_N(3) ♦ 11 

.JL^NIK.) = T^N(K) ♦ 1; 

TWGT-SUMr3) s TWGT_SUM(3) ♦ WGTS<5fJf 
' ^ JWGT'^SUMCK) «. TWGT_SUM(K) ^ WGTS(5.Jf 

. _ie»Xt„n\ \ - 

IF^K > 2 THEN K = 1$ . ^ 

-ENEIL / 

PROCESS ITEMS 6A - f,G 

D0_I_=J.J£L.7J . 

IF MERG PEC.TOPICSOB ♦ I) 9 THEN 001 
T W(3) ^ T.Nr3) ♦ II 

^ ..Ll ^IJiiK} .=,-T^LK) > II 

IF MFRG_REC,TOPIC^(38rJ) « 0 THEN DOl 
TW6T SUM(3) « TWGT^SUMd) ♦ 11 

. TWiil^UMiK!) a TXGr_SUM(K) ♦ IP . 

EVP I ^ , * ' ' r 

K ♦ ir \ 



11 



1)1 
1)1 



'214 
^215 



1 ?. 
1 1 



FNDI ''fM 



3970. 

3<eo. 

, <^000. 

<»010. 
. 4021)^_ 

4030. 

4040. 
_ 4050... 

4060. \ 

4070, ^ 

4090. 
4100. 

- - 4iir 

4120.,--! 
: 4130^, 
_4i40^_l 

4150.. 
,4160^ 

4180. 
4190. 

ttZQt 

4210. 



/» ^ FINISH TOPICS 



*/ 



216 

-211. 



nu I 



21 fl 12 
.219 , 1 2 

220 1_J 

221 . 1 1 
> .id2? A 1 
■223 , 1 1 



■= 1 TO 1» ' . 

TF T_MfT) > 0 THEM DOt ' ' . 

T.SCORE'd) = ( (TW6Ti,SUM(I) ♦ 1000)/T_N{r) ) ♦ 

End; ~ ' " /■ ^ . , - 

Fl SE; T_SCnRE(I> = ^99999?^ 



.5» 



4220. 

._„. 4235*1 
4240.. 
4250; 
42g6.. 



225 V4_.^l 
??6 1 L 



-SELJL 

V(fit^UM(5tl) = TWRT_S^M(1)I 
N(5tl) a T_.N(I)I ' 
_v5CQRE1i5i1 1-3 . T^SCDFE ( I ) > ■ 
TWGT_SUM(I) « or 
T_N(I) = Ot • 
_JL_SCQBEill_=-XU L ^. 



227 11 ENDJ 



.228 1 0 



J:* EfiQC£SS_lQfilC&_ii_STilDEl!iT -OBltWTAJlQNJ. _ 

Kan" /» SPLI]^ HALF, INDICATOR- 

/• PROCESS ITEMS lA - 2D ^ -* 
.n o T T O. 51,- 



4270/ 
42iBfr;- 

4290^ 

4300. 

. 431'6:, 

433a..- 
- 4340s^ 
_.435a._ 
. 4360.' 

4370 i 




1,230 , 



-2324-1 



1 

a; 

2_ 



233 1: s2 



IF MERG REC.T0"PIC6(I) -« 9.THEN OOl 

IF MERr>_REC,T0PIC"6(I) = ft THEN J » 41 

EfiSE. J s MFRfij.REC^ T0P.lC6i 1 1_* 

T„N<3) * T_N(3) ♦ II " 



■ •/ .4390i .1 

•/ 44doi; 

42r20'. H 
443^0.- 

. 44SjOV" 



PL/1 OPTIMIZING COHPIlfR 



STMT LEV NJ^ 



/♦ IWFIGHT - WEIGHT THE ITEMS ON THE IPE»S TO QET TOPIC SCORE! 




TJ^(K) » T_N<K) ♦ If 
^ TWGT^SUMU) 9 TWGT^SUMT3) 

M TiilGlFsUM ( K\ ^ -IWGT^SUM ( K ) 

. K = K% H 

IF K > 2 TI^EN Kail 

Ewai i - 

ENOI 

-,-XJhaSH TOPXCfel - #/ 

= I TO 31 

IF T_M(I) > 0 THEN nOl'^ 

^ l-JSCnREiU ZL,4 1J^GT SUK(l) 

END» 

ELSE T.SCORF(I) a 9999991 
i_Wl.I^SUMt6U)^JLj^riT»SUI4tI)^ 



♦ W6TS(6tJfI)l 
t WGTS(6f Jf I) I 



♦ 1000)/T.NCI)) ♦ ♦SI 



Uif>9l) = T_N(I) I 
SCO*RE(f»»I) = T.SCOREd)! 

^lWGl^SUaXX)--S.^I ,4 

T_N(I) a 01 
T^SCOREd) = Ot 



4460 

4490, . 

4500. 
.4511U... 

4520. 

4530. 

4540^-.. 

4550. 

4560, 

457il^ 

4^60. , 

4590. 
■4ft00>- 



/♦y PROCPSS T0PTC7.- JOB PtACEMENT AND POlLOWUP 

X-^. JJ /t^PLlf-HALF INDICATOR 

/» PROCESS ITEMS lA • IC EXCEPT lA ANO 2H ' 
DO I 3 ?f3.4f5f6f1r^8f lOf ll»12l ^ . ^ 
IF MFffr>^RFr>T0PTC7-LI) ,->»-„9- THEN Oot 



^59 — J 2 

- 260 I*- 2\ 



- IF MFRG1rECVI0PIC7(I) « 8 THEN 'J 
^fLSE 3 s>lFRG^REC,T0P^IG7n> 
JL;.N(3)- = T-NX31.> .11 
T.KMK) s T.N(K) ♦ II 



31 
II 



-.-.26? 



■::2: 



TWGT*SUM<3) » TWGT.SUM(3)..* WGXS(7fJfIhK 
_IWj531^MiKV*. TWGI^SUMCKj- WGTStTtJLtni; 

K » K ♦ U - - 

^IR. K >* 2 THEN K = II ^ 




4610« 
4620« 

4640 • 
4650. 

4670. 
4680* 

4700. 
4710. 
4720^ 
4730. 
47<(0« 
A2£ 



-269 



■-: 270 
"272. 




-'ENDt . , -'t 

. /• PRdCESS ITEMS 'fA ANO 'fB AS ONE RESPONSr 
TF MFRr/RFC.Tnpf rZf.L3i-g-J9- i..ME:RG.REC«.T0PIC7( Ul «,_9_ 
.THFN 60 TO' FINISH-T0PIC7I . r . 
" T«N.f3K= .T_N<3) ♦ II ' I . ' 

■ IJ^()<), P lJilX.1 t 1 \ ' * 



4790. 
4800. 

4820V 
4830. 
A840. 



IF SUBSTR(T0PIC7_STR.13«2) I Sl^STI* (T0PIC7 ' STR. 13,.2r 

THtM- GO TO FINISH'' T0PIC7I '\ 

/» YFS.YFS-ANO No7HgS. HAVE-i>»IEIGHT- Q£_:ZiERb ..J^ 

♦ 13»^) «5 



IF SUBSTR(T0PIC7^STR, 



•op 'THEN DO! 



fOli 



ERjC '^73 I 1 



TW6T.SUM(3jS, = TWGT_SUM(3),* 2l 

~^TtffiT_Sl.lMtK)-g-JUItGT»SHHiJt^ _2.l 

.60 to I;TNJSH«T0P1C7I • 



4850'. 
4860. 

4880. 
4890, 
■4900i 
4910. 
4920. 

4940.. 



77^ 



/f rwmHT - WEIGHrTHE ITtMS ON THE IBris TO" CET TOPIc'siPORi 



STMT MEV NT 



r 




?77 






i 1 








1 0 


?«1 


- -:- 




\ 2 


283-.- 


1.-2 _ 




1 1 


^85 


1 . 1 


- - . .. ?8fi . . 








2B8 


1 I 


289 


I — I-- 


29ft- 


1 1 


291 


I I 



?H2 



293 
. 294 
—2951 



ENO I • . ( ' . r 

'IF SUBSTR(T0PIC7^TR,l3t2) * MO* THEN 00| 

^ IW(iI...^t31-*.4«fiT«SUM.t3). ♦ 

TWGT_SUM(K) » TW6T_St)M(K) ♦ 11 
, . GO TO rTNrSH„T0PIC7»c 

.-1- ..jENDi : , . ~ " 



FINISH- T0PIC7J 

jQa-i-«..i..ii3 . 

IF T^N(I) > 0 THFM DOI 

r T^SCOREU) » C «TWGT.SUM ( I ) 

E.MDJ , - . . • 

ELSE HSCORE(I) a 99Q999I 
W6T _SIJK < 7 ♦ 1). a TW'gT.SUM CI ) I 
— Ni-7«n s-.. ' 



1000)/TJ|J( 




«SC0Rf.{7»n 

TW6T_SUM(I) 
— IJM ( I )^ 



END I 



T^ecpREd) 



-T^fcldl I 

T.scoRE ( n » 

01 

.01 -.. - - 
01 



— 1 . 

/• PROCESS 
K X IJ 




0 
I 



TOPTCB - RFCORDK 

/» 

i^-P<?Of.FSS fill TTEMS-EXCEPT 

ao 1 ». U2, 3»r«5t7l 

IF MERR.REC.T^PtCfld) 

1« IF - " 



IN6 'PRACTISES 4. 
SPLIT HALF INDICATOR 
IF. WHICH 'ISN'T' WEIBHT 



X 



ED 



.•/ 



9 




THEN DDI 

MERQ;)?EC.T0PIC8(I) « 8 THEN J. » 
ELSE J « MFR6_REC.T0PIC8(I). ♦ 
t^N(3) = T,N/3) ♦ H 
^IJR(KL..= _Ol.Kl ♦ If ... ■ 
TW6T|;.SUM(3) « TWGT_SUM(3) 

,Twrwr^suM{K") * twgt.sum(k) 

— (l-«-J<_t_ll. ^. 

IF K« > ? THEN K s I I 



31 



VGTSCfltJ.I) 
WGTS(8»J»I) 



I 

I". 



TOPICS 
TO 3i„- 



4950, 
4960, 
497fl, 
4900. 
4990. 
SOOO.. 
5010. 
^5020. 

S031U 

5040. 
50^0. 
-^60.- 
, 5070; 
!S080.- , 

' 5090. ._ 

5100. 
5110. 

5120.- 

5136% 
5140.. 

, SISO*. 

5160. 
5170, . 

.!&iao»_ 

5190. 
5200. 

- ._S210^ 

5220j, 

5230. 
S241U_ 

5250. 

5260. 
S2tO*_ 

5280. 

5290. 

— :SaOft*_.J 
5310. 
5320. 



T_N(T> > 0 THEN 'DOI ^- ' 

T_*»GfiRE(T) s ( (TWGT.SUMd) 

FJjp- l . ! 

ELSE T^SCORE(I) • 9999991 
W6T.SUW(t,'n » TWGT^SUMnjI. 
iUA±n , ' T^N Oi. I 



lOOO»/TJil(I») ♦ ,51 



^SC0RE(8tI) 
TWGT.SUMd) 

T jnir . 



T^scoREd) . , • or 



« T_SCOREd)l 

-111 




P340. 

, 53504 
saftQ^ 

■' ■* 5370. 
5380, 

...^_...5390^ 



5«»00. 
54,10. 
.5420^...^ 
5430. 



.Pt/I OPTIMIZING COMPILER 



/• 1WE16HT -IWFIGHT THE ITEMS ON THE* IRF«Sj:o GET TOPIC 



THF TRrtS TO GPT 



STMT LrV NT 



. 316 . 1 1 



317 1 



END I 

>/A — BfiOCESSiTOfiljC Q y 



K = II 



/* SPLll HALF INDICATOR 



—31 iU- 
319 
320 



1 0 
1 



322 
•323 

325 
326 
127 



32a 
129 



/» PPOCESS ?A • lA IS NpT WEIGHTED 
— If SUBSTa(-TDE4C9^ST;R,4f>). s--f999» THENI 
ELSE OOt > / 

TlN(3') « T_N(3) ♦ 11 — T ^ 
I^NJiO-. 5..T ja(K) ♦ It 



/• MISSING QA.TA 



IF SUBSTR(T0PI.C9^STRf^f3) =: <000» THEN J = 
FLSE IF S0BSTR<TOPlC9_STPf4f -H) < •002"» 

£USE-4F-SUaSTR(T0PIC9^STRf4f 3) < •005* 

ELSE^J = 31' ' 
TWGT^SUM(3) a TWG^_SUM(3) ♦ J| 
-TtffiT SnM.(KU.j;,TWGT^UM(K), Jl 
K c K 1 t ^ . 

IF K > 2 THFN^tC = II 



-/I 131 



m. 



332 
333 
-334- 



ro 



335 
336 
337 



33B 



339 



342 
343 
-3AA- 



345 
346 

-3Ai- 



349 



35n 
351 
-352- 



ERLC 




/♦ PROCESS ITEM 3A . - ^ > 

_JI lE.-Ja£RGLR£Il^TQPlf^aii_jBLj9_TH£NLiJS0*^ FINISH TQPlC9t ^ ' 

0 T_N'(3> * T_N(3> ♦11.' 

0 T>(K> = T_N(K) ♦ H 

liLjd£RGlfiEC^TDRIi:9'xiJ-Va- 1 - MLfiG ji£C.T0PIC9 IJ) ^ i)..THEN J'^s.DJ 

^0 , f Else j « 21 . . ^ 

0 'TW6T^SUM(3) = TWGT_SUM(3) Jl ^ 
_D Ui(&r;^SiiMrK) =: TWXiI^SUmKX-l-*lJl^ , , „!. 



FINISH' TOPlC^t 
HQ T g 1 TO II 



2 



IF T^Ndi > 0 THEN OOf 

T^SCOREd) « <fTWGT_SUM(I) # KpO ) /T^N ( I ) ) , 

-ENELI ^ . 



ELSE T;:SC0RE(I) s.99«)999l 
WGTlslJM(9tI) = TWnT SUMfDI 
Nr9tlL H„T^tU I :. . . ^ 



SCORE (9fn 
TWGT.SUMa) 
f NfT) ^ 



T^SCOREd)! 

1 01 



ENOt 



T^SCORE < I ) 




0$ 



^ — ERnrFss. TOPirin states bepresentaijon ^.^..1 ; 

K • H /• SPLIT HALF INDICATOR / 

DO I » 1 TO 61 . . 



5B30 
5840 



TF MFRrtJ?F(:^TnPT.Cliia V ^« -,9L-lijEfcU)QL, 



IF MERG^RFC.tO^^lC'iOd) « 6 THEN. J = 3| 
ELSE J r MERG^REC.TOPlClOd) ♦ 1 1 
IJ^iV « T,Nt31 t 11 L 



T^N(K) « T^NCK) ♦ ir 



•79 ^- 



•/ 5860 
a) 5870 

ISBBO 

5890 
5900 

59^0 



PL/I 0PTIMI2WJ6 C0MPILEP 



IXEIGHT - WEIGHT THE ITEMS ON THE IRF»S TO GET TOPIC SCO^E! 



STMT LFV f^T 



357 1 2 

359 I 2 

--359 I 

360 1 2 

361 1 . ? 



-EfciDi t 



TWGT;.SUH(3) » 
TWGT*SUM(K) M 

JL.r JL^t^W 

IF K > 2 THEN 



TWGT^SUMO) 
TW6T^SUM(K) 

K 1$ 



WGTSdOf Jf I) I 
WGTSdOf J«I) I 



TT- 




37S 
'37(S. 



378 

JUS- 



3ftO 
383 ■ 



3BS 
387- 



-3aa- 



389*. 
.390- 
■391. 



392 
■393. 




• 1000)/T_N(I) ) ♦ .5« 



/• • FINISH' TOPICln ♦/ 

-^,DD-L-5-l .T O 3L— 

IF T^N(T) .> 0 THEN 001 

T.SCOKE (I) =t < (TWGT^SUM < I ) 

Ejs!Oi..^ :". ■= _° 

.ELSE T_SCORE«I) = 9999991 ' 
W6T_SIJM(10^ 1) « TWGT^SUM<I) « 

.—-LhtUJlUJ la. TijfJtl) I. * . 

scp«Eno,T) -siZ^cmziDx 

TW6T_S;UM<U a 0« ^ 

^ IJ^lll-! 

T_SC0RE<I> « Oi 
. ENDl' . 
_Z»_J?a«;ESS-aQeiCll...-!--FlNAMCIAL STABILITY . 

K = i; , ^ • • » /♦. SPLIT HALF 
/* PROCESS ITEMS lA- AND IB AS.ON? RESPONSE 
T Ff HEPr7 _ R P(l^T0P lr mU--=-9-& MER6:,REC.IDP4Cllt2>. «.'9 THEN! 



t/. 

INDICATOR 



ELSE' DOI 

^.'T N<3) » T N(3) ♦ II 

T.tN(KL_=_J^«Kl t 1! 

IF SUBSTR(TOPlCU_STR»l»g) = 'IP I 
^ SUBSTR<TOPICn„STR»l»?) s 'OP 

ELSE_lfL.SUaSTR (TOPl£ll^TRf 1 .2) 

ELSE J » 2« 

TWRT'SUMO) « TWGT_SUM(3» ♦ J I 

Ll-J.ttCl5sUK<ta .sf. 'TWGT^SUMCK) ♦ Jl 

K 5 K 1 1 ■ 
IF K > 2 THEN Kill 

-.ENpi ^ ... 



THEN J a 01 
•10? THEhLJ. ? IJ 



PROCESS ITEMS IC, AND ID AS ONE RESPONSE 
JL%. MFRGlREC.TCtPlcm3I -C-9 -L.MERC^gECTORICl 1 (4). * 9-THEMI- 



ELSE DOI 

T MO) e T N(3) ♦ II 

ja_5-T»N tKJ _» . 11 _ 

IF SU8STR"(T0PI611_STR,3,2) MP I 



5930, 
59^0, 

.-S951)» 

, 5960, 
''5970, ^ 

_.- ..SiSO,^ 

.5990, 
6000,. 

6010* 

^ 6020, 
6030, 

• - 6flWl, 

6050, 
6060, 

. . -iiOKU 

6080, 
6090, 

6101)1* 

- 6110, 
, 6120, 

6130^ 

•/ 6140, 
•/ 6150, 

__.£i6fl*. 

6170, 
6180. 

6200. 
' 6210, 

: 622rU_ 

6230, 
6240c 

^50^ 

6260,0 
. 6270, 

:-_.62flfl*- 

6290, 
•/ 6300, 

63ill»- 

6320, 
6'330, 

'. 1 63*0 



SUBSTR(T0PICU..STR»3,2) » »01» THEN J » OI- 
^EtSEL-If-SUBSTAilUfilCU^fiO^ai • 10.! _THEN_jji.ll! 



6350. 
6360, 

.63iO.,_ 



^LSE J » 21 
TW6T' SUM<3) 



Jl 



TW6T.SUM<3) ♦ 
TWGT^ SI.Mtk.l-a- IMGIJ^MtK) l.'l. . _l 

K ■ R'* If '. 



T*^'^ 6380, 
6390, 

6A0(U- 

641 Ov 



PL/1 OPTIMI7ING COMf-ILER 
STMT LfV NT 



IWFTGHT • WEIGHS THE ITEMS ON THE IRF'S TO GET TOPIC SCORES 



* 










. 39B 


1 


I 






I 


1 " 


^''"'^ ' -w:- 








400 


« 


0 

V 






) 


1 








' 2* 


- 


. 4o.i 




2 








2 






j 


2 












407 


J 






'408 


1 * 






409 


\ 


2 


• 


-410 . 


\ 


* 2 




411 


\ 


1 




412 








. 413 


] 


1 




4J4- 


1 


2 




. " 4J5 




2^ 


m 


4lf» 




1 


\ - 


- 417 


! 


1 • 








1 




. 414* 




1 




420 


{ 


I - 




• 421 


1 


I ^ 




4?2 ^ 


1 


1 






1 . 


. K - 






424 - 


1 


0' 
























0 




.A * ?7 








424i- 








429 








ERLC 



IF K > 2 THFM K X 1; 



EMDI-, 



/^^ P-POCK^S TTFMS ?A - 6B EXCEPT 2A 

00 I = 2 10 ^; ' 

IF HERC^HFC.IOPICU (4*1)*^;^ 9 THEN 001 

IF M^PG.R'FC,T0PTCll<44l) = 8 THEN J 
^ FISE.J = MFRG_PEC,T0PICll<4*n 
T*,N<3> 5 T^N(3) ♦ai 
T.^Uk) = T^N(Kj ♦ II • 
TWGT).SiJM(37 = TWtiT_SUM(3) 
IWGT^SUMCK) = TWG1«SUM(K) 
K = K ♦ 11 

IF"K > 2 TMF.N K r 11 



= 31 



WGTS<n.J*I) I 
WGTSdltJfl) I 



END I 



ENO; 



FINISH TUPICll 
Ou\l = I TO 3; 

IF T^Nd) > d THEN 
T.SCfoHEd) 

ei SE T.SCO|vE*M) 
bGl^SUMtll 5^ 
N(llfl) = 
SCORE<lfltI) s 
TWGT^SUMd) 

lIsCOREd) 



Dot 

s C (TWGT^SUMd) 

= 99*^9^9; 
TWGT^SUMdJI 
= T Nd) t 
s T^SCOR^d) 1^ 
01 . - 

= .0; 



1000)/T_Nd)) ♦ ,51 



\ 



INDICATOR 



PROCEISS I0PIC12- INSTRUCTIONAL PROGRAMS 

" \ V /* SPLfT HALF 

/« HRnCFSS\lV^r»n IB AC ONE RESPONSE 
JF SUaS.W{T0™C12^STRd t2.) ^ •99 1 THENJ^* 
FLSF ott;"\ * .1 

T^N<V)*s: T N(3)^* H I ' ^ 

T^WiK) -s T N'(K)"* n 

IF SimSTR.(T0PICl2_STRtlf?) s ilV* I " 

5UBSTR(TO^IC12'JSTRtl #2) « tOH THEN O :i 01 

. \r -.^ -ELSE^F SUBSTR(T0PICl2i,ST>itlf2) =.aO« THEN \J a 

ELSE J-,- 31 il . • . ^ . * ' 
.TWGT;.SnN(^3). « TWGT^SUM<3) ♦• IJI 
iirrlWGTLSUBCK) 5 .TWGT^SUM(K), ♦ Jt 



11 



1'.-. 



K-= K ♦ U 
<*"IF K > 2 THEN" 



I 



6420. 
6430. 
6440. * 

»/ 645JD., 
6460. 
6470* 
64B0. 
6490. 

6520. 

X^5>40, 
^ 6550. 
6560* 
6570'^. 
6580. 
659Q« 
'6600.^ 
^ 6610. 
- . 6620 

, 6630, 
^ /.640,- 
6650.. 
.6660t 
6670. 
• *668D.. 
6690. 
6700. 
^6710.. 
/ *>720. 
6730. ; 
6740.-* 
6750. 
6760. 
6770., 
•6780. 
6790. 
6800^ . 
6810. ^ 
6«20i , 
.6830^, 
6840. 
68S0. 
6860t . 
6870. ' 
6880. 
6890. 
(►900'. 



-» 



Pt/I OPTlMIZtNQ 



COMPILER 



/• I WEIGHT - WEIGHT THE ITEMS ON THE IRF»S TO GET TOPIC SCORE 



EV NT 



/• PROCESS ITEMS 2A AND 2B 
437 1 0 IF SUBSTR(T0PICi2.STRi3.2) 

-438 : Fi s F n ni : 



AS ONE RESPONSE 
» 'QQ* THEN! 



A39 '1 

I. 



4«2 
441 



4<f* • r. 

445 1 



T_N(3) « T_N(3> ♦ II 
T_N(K) » T N(K) ♦ II 
TF S UBSTa-LtORIC12,STRt3.2) 



Eusr 

-Ft SF. 



SUBSTR<T0PIC12.STR.3.2) » 
IF SUBSjRtT0PICl2_STRi3i2) 

J.Jl_2jf_-_ : - - . 
SUMO) = TWGT_SUM(3) ♦Jl- 
TWGT_SUM.(K> ♦ J I 



•JlL.l- - -- 
■ •Ol» T+HEN J 1 
»10» THEN 



It 



447 
448 



1 1 



TWGT ... 
" TWGT^SUM(KJ 

_JC=_K__*J.l 

IF K > 2 THEN 



II 



END I 



449 • 1 0 

4 50 _'_L- q. 



451 I 2 

452 'l 2 

-M3 U 2_ 



/• PROCESS ItfMS 3A - «A 
fW I ■ .1 TO 61 

I£ M £R6 JF C»JQPK]2II.*^--^.9-THEN,DQ> . 

' IF MERG.REC,T0PIC12.(I*4) a g THEN J 
ELSE J « MERG„REC.T0PIC12(I*4) 
1__JJ._N,(^ > « JJH21 - t II - — .... a. , 



6910. 
• 6920* 

.^'...6930*^- 

. . 6940. 

6950.. 

696iu \ 

Ot ' 6970i 
#80. 
6990-- 
' <'7000. 
7010. 
;._.':_7D2Q.. 

7030.;^! 
7040. P 
___711SQ^' > 
•/ 7060. 
7070. 

ifian*. 



31 
II 



7090. 

7,100. 
711 0«- 



4SA y 2 

m '^SS 1. 2 

Jti ,..456 ' 1 2- 

tn X 457 1 2 



458 
4 59 



2 

-21 



T.M(K) = T_N(K) ♦ II 
TWGT'SUMO) r TWGT_SUM(3) ♦, 
_IMfilCsmiltO_s_TW6J^UMiKJ- * 
K « K ♦ II. - s 

IF K > 2 THEN K = 1 1 



FNnt 



460. 1 I 



END! 



-Zl FTMTSH TOPirip 



WGTS(12*J*I) I 
UGTSil2jJ*J) I 



7120. 
7130. 



461 
462 
4ftl 



1 0 
1 I 

1 2. 



464 

465 
4fift 



1 2 

1 .1 
J L 



DO" I » I. TO 31 

IF T,N(n > 0 THEN pOI - 
f grnPFfTI a (tTMfiT SIlMtTl • 1 000) 2T JJ ( 1 ) 1 .51 



457 
468 



1 I 
1 ' 1 



END! ■ 
^ FLSE "T.SCOREU) = 9999991 

afiT^SIIM(l?tT) g TVGT,SUM(J1J 

. N(l2.'l) * TlN(I) I * 



469 1 U 



SCORE (12. I) 
TWGT_SU Mtr> 



■ T_SCORE(I) I- 

hi" : 




470' 

471 
472 



1 I 

-1 — l- 



ENDI 



T_N(I) 
T_SCORE ( I ) 



0! 

oi 



7300. 
7310. 

.I32fl*. 



^—-.^ — 4^3*^ I n 

474 1 0 
-AIS 4—4- 



PROCESS ^TOPICl 3 

» ■ ir 



INSTRUCTIONAL FACILITIES r •/ 
^ y«_SELlt_HALF. INOICATOa 



476 _l 2 



/• PROCESS lAt3A AND 3B ^ 
DO I 1.4^51 , 
IFS^FRnJ^Fr.TOPTCntTl Wj9"TH£N J)QJ-, 



• >7330. 
-^7340. 
!«y_^73SIU- 
*f 73(&0.. 

7370.' 
: 71ftn,. 



\f MER0,RfeC^T0PIC13Cn » 8 THENvJ a ^l 



7390; 



n OMIMiyiNG COMPILER 



/# 1 WEIGHT ^ WEI6HT THE ITEMS ON THE IRF»S TO GET TOPIC S( 



STMT LEV NT 



477 
478 



2 

i 2 
47Sr.^_2- 
480 ; 1 * 2 
4«l 1 2 
.482 -1-4- 2- 
483 1 2- 
484' 1 2 
.485 — 4 J I 



ELSE J « MER6^REe#T0Piei3in* > It ' 
T'N.(3) « T_NC3) II 

jrlN.iKi..jLX^ftUja _t 1 1_ . , ' . . 

'TW6T'SUM<3) ;s TWGT_SUM(3) ♦ W6TS ( Ut J» 1 ) f 
T)rf'GT^SUM(K) s TWGT.SUMCK) ♦ • WGTS C 1 3» Jt I) I 

-K-?^jL±-iJ \ ... . • ^ 

IF K > 2 THEN K.'s'n 



ENHt 



ENDl- 



— 4a6 — 

487 
. 488 



49n 



4^1 



492 

493.^ 



495- 



* 496 
497 

49a. 



49Q 
SOO 
50 1 



502 
503 
.504. 



505 
506 

-5«- 




0 
I 



• /» PROCESS ITEMS 2A ^ND 2B aS ONE RESPONSE 

— ^-...SUB$Ta4J£)PIcn^-SXRf2>2)-S-.!99* T^ENf , . a 

ELSE DO! , v 
^ ^ T:.N(3) « T^N(3> ♦ 11 ■ 

' T M(X) m T N(K) -^.OJ. ^ 

- IF SU8STR(T0PIC13_STR»2»2) = Ml» t , 

> SUBSTR(T0PIC13^STR>?»2)' « tOP THEN J - 







•"1 END! ' 
FiNlSH^TDfilCXa. 



,FL-SF TF SUBSTRitQeiC13^lRi2»2),.g •.IQ« THEN .J 
ELSE J = 2t 

TWGT'SUM(3) »^TWGT_SUM(3) ♦ Jl 

-XWGl5sUHIKJ-,a TWfiT^SUM(K)- » Jt . _ 



01 
5 11 



7-400- 
7410. 
742Q. 
743^, 
7440'. 

p60, 
7470 
74aQ 
7490 
7500 
■ -ISIO. 
7520 
J530 
(7540 
V 7550 
7560 
-.7.520 
7^80 
7590 
J 7#»0Q 
7610 
. 7620 
_I63a 



0 00 I « I TO. 3t 

1 IF T NCI) > 0 THEf^ DO! 
? T^SroRF(T) «/fiJiGI^UHi I) 



2 
*1 



^ENDI 

ELSE T' SCORE rt) s 999Q991 
tfGT^UM-rntl) JL X^dGI^SUMili't 



?9I f 



N(13f I) 
SCORE (I3fn 
TWGT^SUMil) 



TWGT.^-Sl 
T^N.tl) 
T_SCORE< I) 



T^fJ<l) t 
» T SC0RE(1)I 



= .0t 

a ot 



\ 



-01 



DEVELOP 
no T B 1 



IRF SCORES 



•/ 



7640 

1266Q 

7670 
7680 

jr^M 

•. 7700 
7710 
7720 
7730 
7740 

7750 

\ 7760 
7770 
-MfiO 



irf..wgt_si)m ■ 
irfa.w6t_sum, 

TRFR,WfiT,SIIM 



IRF_N 
IRFA_N 
TBFfl^N 



ENOK' 
tF- IRF_N 
IflC, 



IRF.W6T.SUM ♦ W6,T;,SUM(1»3) t , 
^ IRFA_WGT_SU*M ♦ W6T' SUMdVl) » 

a-JfiFBJWiT^UMJ*- MfiT^UMll tZU .j 

IPFJj. ♦ NdtSU 
« IRFA N ♦ NtUDI 

■ ItjFflJil ♦ NAX^ail . 



ENDI 



> 0 THEN OOt ... ■ ~ 

^COffC..g nTRr>fiTj5UM-Jg- lOOO) ✓IRE'.N) 



8-3 



/ 7790 
7800 

:_:__2aiii 

7820 
7830 
L4fl 
7850 
7860 
-^7870 
7980 
♦ ^ 



/* IWFIGHT - WtlGHT'TME IJEMS UM THE" tRF«f» TO GET TOPIC SC 



STMT LEV NT 



m 
i 



521 
S27 



510 

S3S 
» S36 

S3» 

. 54ft 
1 541"' 



I 0 

1 0 

\l 1 

1 1 



) 1 
1 I 

1.^ 0 



Khfn ' ' ' • 

IP JfT-ft^N > 0 THEM-DOt 

feHfJl • ■ • , ~ , 

ELSE IRf^^C^RE = 999999.$ ■ < " 



0 

0 

.a 
u 



/* 'wf-ITir OUIfUT ^ ^ . , 

WPTTF FILt (WGHTOAT) FROM (wGHT PPC) I ^ 
OllT^CNT s OUT^CNT ♦ ); " • ^ 

' PUT SKIP (2:0 t . , » , « • 

PUT OAfACwGHT^REC^MlO) t 
n{* I = 1 fcv 13r ' * 

PUf UAT/^fSC0P£'nt3))t 
ENOI ' ^ 
PUT DATA (IRF SCORE) I 
GO TO REAb^MFRGOATl 

^§l'('SL* FTLFS: * - ^ 

CLOSE FILL^lMEf-GPfAl ) f 'FILE (WGHfTOAT) I 
PUT n/»TA(lM^r.r«T) I 
PUT HATA (OUT CNT) ; \ - . • 
PUT SKIP(2) EDIT (•EMD OR J08M (XClO)fA)l / 
ENO TWFIGHrt 



7890 • 
7.900 V 
•791 0# 
7920. 
7930^. 
79a6^^ 
. 7950* 
^^7960• 
7970. 
7980. 
7990. 

aooo* 

" 8010. 
8020, 
. 8030 ♦ 

(fo^o. 

8050. 
8060 « 
J 80^0.' 
. .8080. 
.8690. 
81%). 

8iro. 

8120. 
.-8130. 
8140. 
. 8150. 
8160. 



